-- Logs begin at Fri 2021-10-29 00:34:28 UTC, end at Fri 2021-10-29 01:46:34 UTC. -- Oct 29 01:20:01.601291 dv-cinder-813984-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 29 01:20:01.611057 dv-cinder-813984-5-iscsi devstack@n-api.service[101148]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 29 01:20:01.612946 dv-cinder-813984-5-iscsi devstack@n-api.service[101148]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Oct 29 01:20:01 2021] *** Oct 29 01:20:01.612946 dv-cinder-813984-5-iscsi devstack@n-api.service[101148]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 29 01:20:01.612946 dv-cinder-813984-5-iscsi devstack@n-api.service[101148]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 29 01:20:01.612946 dv-cinder-813984-5-iscsi devstack@n-api.service[101148]: nodename: dv-cinder-813984-5-iscsi Oct 29 01:20:01.612946 dv-cinder-813984-5-iscsi devstack@n-api.service[101148]: machine: x86_64 Oct 29 01:20:01.612946 dv-cinder-813984-5-iscsi devstack@n-api.service[101148]: clock source: unix Oct 29 01:20:01.612946 dv-cinder-813984-5-iscsi devstack@n-api.service[101148]: pcre jit disabled Oct 29 01:20:01.612946 dv-cinder-813984-5-iscsi devstack@n-api.service[101148]: detected number of CPU cores: 4 Oct 29 01:20:01.612946 dv-cinder-813984-5-iscsi devstack@n-api.service[101148]: current working directory: / Oct 29 01:20:01.612946 dv-cinder-813984-5-iscsi devstack@n-api.service[101148]: detected binary path: /usr/bin/uwsgi-core Oct 29 01:20:01.613643 dv-cinder-813984-5-iscsi devstack@n-api.service[101148]: your processes number limit is 47680 Oct 29 01:20:01.613643 dv-cinder-813984-5-iscsi devstack@n-api.service[101148]: your memory page size is 4096 bytes Oct 29 01:20:01.613643 dv-cinder-813984-5-iscsi devstack@n-api.service[101148]: detected max file descriptor number: 2048 Oct 29 01:20:01.613643 dv-cinder-813984-5-iscsi devstack@n-api.service[101148]: lock engine: pthread robust mutexes Oct 29 01:20:01.613643 dv-cinder-813984-5-iscsi devstack@n-api.service[101148]: thunder lock: enabled Oct 29 01:20:01.613643 dv-cinder-813984-5-iscsi devstack@n-api.service[101148]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 29 01:20:01.613643 dv-cinder-813984-5-iscsi devstack@n-api.service[101148]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Oct 29 01:20:01.657719 dv-cinder-813984-5-iscsi devstack@n-api.service[101148]: Python main interpreter initialized at 0x564fe5c1e9c0 Oct 29 01:20:01.657719 dv-cinder-813984-5-iscsi devstack@n-api.service[101148]: python threads support enabled Oct 29 01:20:01.657719 dv-cinder-813984-5-iscsi devstack@n-api.service[101148]: your server socket listen backlog is limited to 100 connections Oct 29 01:20:01.657719 dv-cinder-813984-5-iscsi devstack@n-api.service[101148]: your mercy for graceful operations on workers is 90 seconds Oct 29 01:20:01.658134 dv-cinder-813984-5-iscsi devstack@n-api.service[101148]: mapped 403077 bytes (393 KB) for 2 cores Oct 29 01:20:01.658134 dv-cinder-813984-5-iscsi devstack@n-api.service[101148]: *** Operational MODE: preforking *** Oct 29 01:20:01.658417 dv-cinder-813984-5-iscsi devstack@n-api.service[101148]: *** uWSGI is running in multiple interpreter mode *** Oct 29 01:20:01.658417 dv-cinder-813984-5-iscsi devstack@n-api.service[101148]: spawned uWSGI master process (pid: 101148) Oct 29 01:20:01.658629 dv-cinder-813984-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 29 01:20:01.659500 dv-cinder-813984-5-iscsi devstack@n-api.service[101148]: spawned uWSGI worker 1 (pid: 101149, cores: 1) Oct 29 01:20:01.659500 dv-cinder-813984-5-iscsi devstack@n-api.service[101148]: spawned uWSGI worker 2 (pid: 101150, cores: 1) Oct 29 01:20:01.659680 dv-cinder-813984-5-iscsi devstack@n-api.service[101148]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 29 01:20:03.321870 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 29 01:20:03.321870 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: from cryptography.utils import int_from_bytes Oct 29 01:20:03.322573 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 29 01:20:03.322573 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: from cryptography.utils import int_from_bytes Oct 29 01:20:03.378858 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 29 01:20:03.378858 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: from cryptography.utils import int_from_bytes Oct 29 01:20:03.379509 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 29 01:20:03.379509 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: from cryptography.utils import int_from_bytes Oct 29 01:20:05.980145 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 29 01:20:05.980715 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 29 01:20:05.980866 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 29 01:20:05.981230 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 29 01:20:05.981486 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 29 01:20:05.981875 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:05.982203 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:05.982523 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:05.982837 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:05.983166 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:05.983473 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:05.983814 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:05.984133 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:05.984460 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:05.984719 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:05.985031 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:05.985356 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-813984-5-iscsi {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:05.985676 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:05.985978 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:05.986283 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:05.986599 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:05.986902 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:05.987218 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:05.987312 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 29 01:20:05.987685 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:05.987807 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 29 01:20:05.988021 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 29 01:20:05.988114 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:05.988391 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 29 01:20:05.988496 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:05.988658 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 29 01:20:05.988752 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:05.989030 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:05.989131 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:05.989358 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:05.989464 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:05.989681 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:05.989783 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:05.989986 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:05.990133 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:05.990303 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:05.990455 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:05.990602 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:05.990738 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:05.990917 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:05.991057 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:05.991221 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:05.991363 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:05.991548 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:05.991686 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-813984-5-iscsi {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:05.991842 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:05.991945 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:05.992283 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:05.992600 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:05.992729 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:05.993009 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:05.993102 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-813984-5-iscsi {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:05.993320 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:05.993414 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:05.993625 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:05.993713 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:05.993936 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:05.994034 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:05.994254 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:05.994346 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:05.994559 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:05.994651 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:05.994882 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:05.994976 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:05.995195 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:05.995285 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:05.995512 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:05.995709 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:05.995890 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:05.996042 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:05.996134 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:05.996350 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:05.996450 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:05.996664 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:05.996781 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:05.997007 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:05.997125 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:05.997312 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:05.997413 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:05.997615 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:05.997709 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:05.997865 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:05.997969 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:05.998171 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:05.998272 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:05.998491 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:05.998586 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:05.998809 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:05.998905 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:05.999127 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:05.999231 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-813984-5-iscsi {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:05.999377 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:05.999518 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:05.999702 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:05.999869 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:05.999981 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.000185 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.000280 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.000552 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.000648 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.000856 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.000991 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.001158 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.001252 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.001462 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.001700 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.001791 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.001882 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.002062 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.002162 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.002366 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.002473 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.002667 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.002793 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.002983 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.003111 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.003293 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.003431 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.003612 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.003764 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.003946 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.004063 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.004265 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.004376 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.004659 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.87 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.004751 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.004910 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.87 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.005010 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.005217 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.005315 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.005514 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.005649 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.005820 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.005922 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.006140 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.006228 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.006458 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.006545 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.006777 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.006923 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.007018 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.007104 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.007265 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.007376 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.007585 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.007775 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.008158 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.008465 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.008556 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.008784 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.008885 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.009064 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.009157 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.009368 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.009458 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.009677 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.009781 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.009989 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.010082 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.010294 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.010490 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.010582 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.010670 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.011351 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.011890 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.011890 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.012068 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.012159 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.012240 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.012325 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.012426 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.012518 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.012599 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.012689 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.012770 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.012850 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.012938 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.87 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.013018 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.013103 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.87 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.013262 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.013388 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.013569 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.013706 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.013874 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.014027 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.014192 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.014338 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.014511 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.014658 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.014815 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.014979 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.015119 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.015286 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.015422 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.015607 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.015751 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.016004 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.016112 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.016317 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.016420 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.016644 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.016730 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.016953 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.017118 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.017268 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.017412 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.017549 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.017684 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.017830 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.017979 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.018120 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.018264 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.018399 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.018533 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.018676 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.018818 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.018954 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.019089 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.019246 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.019344 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.019555 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.020547 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.020697 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.020844 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.020986 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.021130 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.021271 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.021413 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.021554 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.021695 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.021835 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.021979 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.021979 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.022244 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.022387 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.022534 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.022678 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.022825 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.022962 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.023097 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.023232 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.023940 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.024031 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.024131 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.024214 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.024293 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.024371 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.024450 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.024450 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.025179 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.025179 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.025439 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.025533 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.025619 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.025707 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.025797 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.025983 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.026120 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.026293 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.026390 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.026608 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.026698 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.026927 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.027022 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.027239 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.027331 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.027551 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.027641 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.027892 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.027983 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.028198 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.028286 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.028508 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.028611 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.028820 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.028916 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.029124 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.029211 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.029434 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.029523 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.029740 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.029827 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.030048 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.030153 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.030356 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.030459 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.030665 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.030752 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.030969 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.031069 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.031274 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.031362 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.031576 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.031673 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.031933 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.032035 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.032257 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.032345 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.032568 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.032666 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.032910 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.033013 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.033216 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.033303 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.033540 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:20:06.033629 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.033864 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.033997 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.034177 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.034266 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.034499 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.034601 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.034813 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.034925 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.035121 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.035212 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.035433 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.035529 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.035786 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.035880 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.036101 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.036227 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.036412 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.036501 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.036741 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.036831 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.037055 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.037152 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.037370 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.037460 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.037674 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.037770 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.037980 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.038068 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.038287 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.038383 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.038599 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.038688 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.038964 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.039592 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.039927 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.040268 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.040437 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.040581 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.040768 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.040918 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.041090 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.041228 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.041415 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.041543 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.041752 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.041865 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.042081 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.042201 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.042404 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.042499 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.042750 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.042839 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.043060 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.043156 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.043385 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.043480 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.043696 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.043834 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.044029 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.044126 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.044351 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.044441 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.044657 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.044745 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.044961 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.045050 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.045272 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.045359 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.045580 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.045669 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.045889 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.045978 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.046198 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.046344 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.046521 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.046611 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.046832 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.046922 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.047143 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.047232 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.047451 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.047549 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.047814 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.047906 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.048121 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.048221 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.048446 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.048553 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.048753 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.048841 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.049070 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.049164 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.049376 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.049477 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.049686 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.049775 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.049989 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.050078 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.050292 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.050390 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.050596 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.050729 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.050906 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.051001 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.051210 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.051301 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.051513 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.051620 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.051839 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.051931 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.052143 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.052234 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.052445 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.052535 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.052766 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.052855 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.053073 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.053161 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.053373 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.053461 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.053677 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.053766 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.053977 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.054066 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.054296 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.054435 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.055140 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.055498 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.055770 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.055906 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.056054 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.056192 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.056337 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.056496 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.056636 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.056774 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.056908 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.057080 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.057226 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.057392 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.057528 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.057704 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.057843 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.058012 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.058150 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.058323 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.058469 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.058644 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.058781 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.058956 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.059107 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.059275 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.059371 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.059586 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.059675 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.059937 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.060040 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.060248 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.060337 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.060554 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.060649 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.060857 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.060954 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.061162 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.061250 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.061474 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.061562 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.061784 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.061881 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.062092 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.062190 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.062404 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.062494 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.062728 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.062827 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.063040 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.063128 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.063349 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.063437 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.063654 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.063762 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.063987 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.064076 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.064294 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.064380 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.064612 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.064703 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.064920 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.065017 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.065238 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.065327 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.065547 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.065636 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.065867 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.065956 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.066177 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.066273 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.066495 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.066629 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.066799 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.066889 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.067114 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.067216 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.067425 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.067550 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.067807 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.067901 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.068084 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.068189 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.068398 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.068486 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.068718 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.068806 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.069036 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.069150 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.069338 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.069428 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.069648 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.069737 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.069950 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.070051 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.070813 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.071067 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.071205 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.071636 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.071759 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.071980 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.072070 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.072295 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.072396 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.072603 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.072704 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.072919 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.073015 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.073230 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.073319 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.073533 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.073912 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.074100 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.074189 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.074413 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.074503 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.074739 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.074841 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.075050 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.075139 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.075375 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.075472 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.075699 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.075870 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.076031 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.076157 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.076337 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.076428 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.076660 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.076756 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.076970 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.077057 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.077271 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.077358 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.077576 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.077708 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.077879 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.077968 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.078207 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.078294 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.078522 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.078611 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.078827 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.078916 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.079142 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.079228 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.079460 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.079555 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.079793 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.079887 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.080106 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.080206 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.080416 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.080505 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.080724 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.080811 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.081034 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.081176 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.081346 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.081434 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.081662 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.081751 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.081971 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.082142 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.082282 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.082372 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.082587 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.082674 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.082894 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.082991 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.083202 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.083291 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.083508 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.083597 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.083839 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.083931 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.084152 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.084243 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.084457 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.084547 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.084766 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.084857 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.085083 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.085183 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.085441 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.085656 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.085771 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.086061 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.086457 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.086623 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.086780 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.086962 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.087103 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.087282 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.087424 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.087594 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.087779 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.087932 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.088111 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.088242 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.088425 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.088593 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.088732 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.088910 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.089045 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.089220 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.089350 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.089542 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.089655 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.089869 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.089958 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.090184 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.090272 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.090503 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.090592 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.090818 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.090908 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.091133 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.091222 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.091440 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.091543 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.091760 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.091862 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.092086 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.092174 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.092388 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.092490 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.092706 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.092803 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.093007 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.093095 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.093320 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.093415 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.093623 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.093713 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.093945 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.094033 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.094254 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.094341 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.094556 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.094646 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.094861 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.094950 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.095163 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.095252 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.095481 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.095577 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.095834 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.096075 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.096164 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.096412 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.096510 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.096730 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.096863 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.097053 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.097142 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.097375 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.097471 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.097696 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.097785 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.097997 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.098138 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.098293 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.098434 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.098590 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.098725 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.098899 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.099040 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.099206 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.099342 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.099507 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.099684 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.099877 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.100023 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.100174 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.100317 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.100453 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.100589 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.100727 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.100870 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.101006 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.101148 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.101295 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.101926 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.102161 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.102501 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.102638 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.102871 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.103011 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.103179 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.103318 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.103483 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.103628 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.103822 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.103970 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.104133 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.104278 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.104436 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.104616 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.104756 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.104954 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.105046 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.105292 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.105439 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.105614 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.105754 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.105915 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.106053 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.106216 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.106363 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.106544 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.106681 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.106818 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.106975 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.107109 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.107321 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.107461 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.107607 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.107788 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.107931 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.108066 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.108212 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.108349 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.108493 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.108635 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.108782 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.108918 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.109063 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.109199 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.109368 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.109507 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.109677 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.109821 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.109985 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.110127 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.110300 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.110438 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.110614 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.110772 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.110916 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.111051 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.111221 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.111360 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.111520 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.111670 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.111843 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.111978 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.112146 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.112290 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.112450 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.112593 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.112746 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.112885 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.113038 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.113172 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.113341 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.113475 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.113659 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.113793 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.113965 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.114098 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.114267 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.114403 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.114569 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.114719 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.114858 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.114949 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.115194 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.115329 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.115495 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.115628 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.115838 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.115972 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.116159 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.116299 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.116468 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.116560 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.116777 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.116926 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.117693 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.117953 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.118277 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.118418 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.118609 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.118757 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.118921 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.119063 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.119243 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.119383 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.119558 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.119706 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.119888 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.120024 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.120196 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.120346 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.120551 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.120709 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.120823 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.120894 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.121112 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.121250 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.121425 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.121581 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.121765 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.121905 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.122089 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.122227 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.122380 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.122516 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.122697 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.122836 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.123002 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.123139 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.123312 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.123458 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.123604 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.123765 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.123940 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.124083 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.124229 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.124373 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.124539 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.124678 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.124845 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.124992 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.125151 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.125289 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.125455 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.125614 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.125751 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.125898 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.126034 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.126169 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.126330 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.126467 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.126638 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.126785 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.126944 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.127035 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.127266 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.127358 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.127575 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.127674 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.127906 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.127999 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.128215 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.128329 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.128521 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.128612 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.128833 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.128936 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.129199 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.129287 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.129516 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.129687 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.129839 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.130002 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.130152 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.130314 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.130475 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.130620 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.130790 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.130932 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.131108 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.131243 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.131417 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.131559 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.131742 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.131902 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.132071 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.132213 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.132385 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.132656 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.133413 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.133504 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.133820 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.134132 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.134223 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.134437 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.134526 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.134740 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.134848 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.135049 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.135153 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.135371 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.135461 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.135676 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.135818 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.136009 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.136101 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.136356 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.136453 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.136672 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.136760 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.136975 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.137063 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.137295 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.137383 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.137614 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.137781 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.137931 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.138021 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.138247 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.138335 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.138559 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.138709 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.138875 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.139023 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.139190 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.139335 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.139500 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.139657 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.139857 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.140016 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.140176 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.140342 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.140485 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.140646 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.140800 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.140962 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.141108 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.141273 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.141423 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.141596 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.141730 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.141918 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.142166 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.142262 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.142483 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.142573 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.142798 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.142887 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.143109 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.143198 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.143431 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.143521 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.143762 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.143853 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.144087 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.144176 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.144407 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.144497 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.144719 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.144808 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.145108 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.145204 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.145432 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.145522 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.145747 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.145843 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.146055 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.146151 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.146362 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.146450 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.146672 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.146770 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.146978 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.147077 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.147284 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.147373 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.147607 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.147695 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.147939 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.148030 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.148289 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.148928 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.149129 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.149475 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.149714 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.149878 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.150048 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.150211 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.150361 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.150639 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.150756 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.150958 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.151049 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.151269 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.151357 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.151598 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.151786 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.151953 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.152058 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.152283 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.152375 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.152591 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.152687 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.152915 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.153016 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.153227 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.153317 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.153535 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.153632 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.153840 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.153942 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.154145 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.154235 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.154489 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.154578 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.154795 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.154885 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.155116 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.155207 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.155434 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.155529 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.155764 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.155858 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.156087 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.156175 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.156413 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.156501 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.156735 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.156826 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.157048 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.157135 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.157371 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.157525 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.157691 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.157782 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.157997 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.158086 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.158299 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.158398 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.158609 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.158729 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.158948 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.159037 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.159253 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.159355 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.159555 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.159645 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.159887 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.159978 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.160191 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.160298 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.160492 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.160582 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.160792 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.160881 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.161113 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.161210 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.161416 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.161515 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.161736 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.161833 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.162044 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.162134 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.162351 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.162441 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.162653 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.162743 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.162954 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.163044 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.163281 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.163370 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.163585 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.163673 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.163999 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.164098 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.164401 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.164893 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.164984 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.165215 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.165314 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.165529 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.165617 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.165856 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.165944 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.166170 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.166260 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.166506 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.166596 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.166819 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.166909 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.167170 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.167267 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.167482 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.167617 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.167832 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.167924 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.168150 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.168240 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.168463 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.168553 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.168780 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.168870 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.169098 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.169195 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.169416 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.169514 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.169742 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.169983 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.170075 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.170312 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.170401 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.170630 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.170719 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.170949 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.171047 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.171264 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.171355 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.171572 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.171662 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.171906 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.171998 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.172213 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.172302 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.172529 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.172651 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.172838 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.172942 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.173141 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.173230 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.173473 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.173611 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.173802 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.173895 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.174110 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.174200 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.174435 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.174535 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.174749 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.174846 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.175056 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.175145 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.175364 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.175454 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.175668 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.175777 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.176041 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.176143 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.176353 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.176442 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.176658 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.176753 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.176975 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.177072 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.177296 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.177397 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.177612 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.177761 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.177923 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.178075 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.178235 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.178383 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.178551 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.178698 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.178864 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.179055 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.179195 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.179333 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.179511 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.179647 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.180016 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.180338 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.180437 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.180667 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.180757 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.181006 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.181095 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.181324 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.181415 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.181636 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.181725 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.181951 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.182050 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.182269 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.182366 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.182795 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.182886 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.183114 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.183217 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.183449 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.183539 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.183791 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.183886 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.184120 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.184231 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.184439 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.184528 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.184755 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.184843 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.185073 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.185171 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.185381 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.185476 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.185688 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.185779 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.186000 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.186090 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.186309 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.186397 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.186615 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.186704 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.186940 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.187039 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.187253 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.187343 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.187560 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.187657 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.187911 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.188012 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.188225 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.188316 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.188543 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.188756 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.188908 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.189104 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.189229 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.189421 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.189548 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.189749 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.189839 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.190074 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.190164 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.190392 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.190490 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.190699 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.190789 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.191021 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.191110 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.191327 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.191425 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.191632 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.191721 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.191971 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.192061 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.192279 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.192382 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.192589 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.192680 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.192894 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.192985 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.193206 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.193304 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.193515 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.193606 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.193819 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.193918 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.194131 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.194223 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.194433 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.194522 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.194758 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.194847 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.195065 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.195983 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.196080 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.196357 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.196513 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.196790 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.196950 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.197119 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.197217 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.197432 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.197569 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.197744 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.197873 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.198052 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.198143 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.198368 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.198465 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.198930 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.199024 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.199237 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.199326 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.199542 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.199678 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.199878 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.199969 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.200181 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.200270 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.200492 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.200581 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.200798 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.200889 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.201103 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.201198 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.201416 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.201517 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.201720 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.201805 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.202040 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.202254 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.202344 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.202611 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.202702 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.202935 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.203023 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.203261 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.203348 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.203590 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.203679 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.203940 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.204032 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.204259 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.204475 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.204575 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.204856 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.204958 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.205178 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.205267 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.205495 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.205592 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.205810 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.205899 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.206119 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.206210 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.206427 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.206517 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.206727 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.206814 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.207044 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.207133 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.207350 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.207440 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.207658 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.207765 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.207989 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.208106 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.208296 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.208385 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.208610 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.208707 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.208916 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.209013 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.209223 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.209318 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.209535 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.209626 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.209840 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.209940 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.210148 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.210239 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.210456 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.210551 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.210830 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.211437 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.211652 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.212001 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.212139 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.212315 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.212460 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.212628 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.212774 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.212945 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.213083 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.213255 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.213404 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.213572 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.213718 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.213902 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.214035 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.214218 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.214346 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.214525 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.214677 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.214949 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.215051 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.215265 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.215372 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.215585 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.215676 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.215931 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.216021 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.216241 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.216331 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.216564 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.216662 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.216878 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.216965 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.217187 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.217276 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.217510 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.217600 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.217820 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.218067 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.218166 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.218462 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.218551 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.218789 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.218876 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.219114 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.219213 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.219421 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.219518 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.219760 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.219896 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.220054 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.220145 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.220364 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.220453 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.220696 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.220785 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.221010 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.221101 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.221327 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.221424 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.221636 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.221724 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.221947 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.222037 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.222255 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.222344 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.222569 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.222666 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.222883 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.222973 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.223196 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.223285 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.223503 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.223600 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.223856 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.223951 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.224173 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.224262 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.224485 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.224587 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.224796 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.224886 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.225107 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.225205 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.225418 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.225590 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.225730 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.225818 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.226042 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.226132 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.226385 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.226478 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.226696 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.227024 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.227194 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.227336 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.227546 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.227640 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.227899 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.227993 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.228221 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.228311 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.228600 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.228698 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.228911 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.229007 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.229226 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.229330 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.229538 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.229628 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.229847 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.229990 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.230162 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.230263 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.230477 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.230574 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.230803 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.231024 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.231131 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.231364 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.231462 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.231686 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.231811 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.232053 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.232157 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.232403 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.232492 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.232749 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.232890 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.233077 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.233201 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.233309 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101149) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 29 01:20:06.233415 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.233693 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.234092 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.234414 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.234764 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.235090 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.235423 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.235756 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.236094 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.236415 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.236745 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.237074 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.237398 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.237714 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.238053 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.238372 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.238689 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.239008 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.239324 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.239641 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.239996 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.240331 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.240663 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.240975 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.241305 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.241627 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.241952 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.242525 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.242862 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.243307 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.243631 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.243983 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.244305 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.244627 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.244952 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.245275 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.245609 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.245940 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.246273 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.246604 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.246960 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.247279 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.247631 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.247990 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:20:06.248238 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 29 01:20:06.256724 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG oslo_db.sqlalchemy.engines [None req-ad15e823-721b-40ea-a48f-02feb998f5c0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101149) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 29 01:20:06.272330 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG oslo_db.sqlalchemy.engines [None req-06d25c73-14c0-4e2f-99eb-bfc2c5f3e06f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101150) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 29 01:20:06.431998 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.context [None req-ad15e823-721b-40ea-a48f-02feb998f5c0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),20da1628-5ce3-4c52-99e0-a722d80928b0(cell1) {{(pid=101149) load_cells /opt/stack/nova/nova/context.py:464}} Oct 29 01:20:06.436448 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG oslo_concurrency.lockutils [None req-ad15e823-721b-40ea-a48f-02feb998f5c0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:06.438072 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG oslo_concurrency.lockutils [None req-ad15e823-721b-40ea-a48f-02feb998f5c0 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:06.438897 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG oslo_concurrency.lockutils [None req-ad15e823-721b-40ea-a48f-02feb998f5c0 None None] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:06.440870 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG oslo_concurrency.lockutils [None req-ad15e823-721b-40ea-a48f-02feb998f5c0 None None] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101149) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:06.452249 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG oslo_db.sqlalchemy.engines [None req-ad15e823-721b-40ea-a48f-02feb998f5c0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101149) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 29 01:20:06.452577 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.context [None req-06d25c73-14c0-4e2f-99eb-bfc2c5f3e06f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),20da1628-5ce3-4c52-99e0-a722d80928b0(cell1) {{(pid=101150) load_cells /opt/stack/nova/nova/context.py:464}} Oct 29 01:20:06.453631 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG oslo_db.sqlalchemy.engines [None req-ad15e823-721b-40ea-a48f-02feb998f5c0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101149) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 29 01:20:06.457354 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG oslo_concurrency.lockutils [None req-06d25c73-14c0-4e2f-99eb-bfc2c5f3e06f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:06.458969 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG oslo_concurrency.lockutils [None req-06d25c73-14c0-4e2f-99eb-bfc2c5f3e06f None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:06.459857 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG oslo_concurrency.lockutils [None req-06d25c73-14c0-4e2f-99eb-bfc2c5f3e06f None None] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:20:06.462634 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG oslo_concurrency.lockutils [None req-06d25c73-14c0-4e2f-99eb-bfc2c5f3e06f None None] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=101150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:20:06.475465 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG oslo_db.sqlalchemy.engines [None req-06d25c73-14c0-4e2f-99eb-bfc2c5f3e06f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101150) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 29 01:20:06.477808 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG oslo_db.sqlalchemy.engines [None req-06d25c73-14c0-4e2f-99eb-bfc2c5f3e06f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101150) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 29 01:20:06.715573 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG oslo_db.sqlalchemy.engines [None req-ad15e823-721b-40ea-a48f-02feb998f5c0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101149) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 29 01:20:06.738596 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG oslo_db.sqlalchemy.engines [None req-06d25c73-14c0-4e2f-99eb-bfc2c5f3e06f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101150) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 29 01:20:07.157595 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: WARNING keystonemiddleware.auth_token [None req-ad15e823-721b-40ea-a48f-02feb998f5c0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 29 01:20:07.165202 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: WARNING keystonemiddleware.auth_token [None req-ad15e823-721b-40ea-a48f-02feb998f5c0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 29 01:20:07.183998 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: WARNING keystonemiddleware.auth_token [None req-06d25c73-14c0-4e2f-99eb-bfc2c5f3e06f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 29 01:20:07.190592 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: WARNING keystonemiddleware.auth_token [None req-06d25c73-14c0-4e2f-99eb-bfc2c5f3e06f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 29 01:20:07.513062 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: WARNING keystonemiddleware.auth_token [None req-ad15e823-721b-40ea-a48f-02feb998f5c0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 29 01:20:07.518089 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: WARNING keystonemiddleware.auth_token [None req-ad15e823-721b-40ea-a48f-02feb998f5c0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 29 01:20:07.524464 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564fe5c1e9c0 pid: 101149 (default app) Oct 29 01:20:07.526524 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi [None req-ad15e823-721b-40ea-a48f-02feb998f5c0 None None] Calling method '>' {{(pid=101149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:20:07.527671 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: INFO nova.api.openstack.requestlog [None req-ad15e823-721b-40ea-a48f-02feb998f5c0 None None] 10.222.0.87 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001694 Oct 29 01:20:07.528106 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: [pid: 101149|app: 0|req: 1/1] 10.222.0.87 () {50 vars in 788 bytes} [Fri Oct 29 01:20:07 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:20:07.539985 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: WARNING keystonemiddleware.auth_token [None req-06d25c73-14c0-4e2f-99eb-bfc2c5f3e06f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 29 01:20:07.545090 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: WARNING keystonemiddleware.auth_token [None req-06d25c73-14c0-4e2f-99eb-bfc2c5f3e06f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 29 01:20:07.551295 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564fe5c1e9c0 pid: 101150 (default app) Oct 29 01:21:33.297127 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi [None req-ad15e823-721b-40ea-a48f-02feb998f5c0 None None] Calling method '>' {{(pid=101149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:33.298120 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: INFO nova.api.openstack.requestlog [None req-ad15e823-721b-40ea-a48f-02feb998f5c0 None None] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Oct 29 01:21:33.298773 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: [pid: 101149|app: 0|req: 2/2] 10.222.0.87 () {54 vars in 930 bytes} [Fri Oct 29 01:21:33 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:21:33.757855 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi [None req-ec524d5d-0707-46d0-89da-67e53a8d148d admin admin] Calling method '>' {{(pid=101150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:33.788203 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: INFO nova.api.openstack.requestlog [None req-ec524d5d-0707-46d0-89da-67e53a8d148d admin admin] 10.222.0.87 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.482064 Oct 29 01:21:33.789092 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: [pid: 101150|app: 0|req: 1/3] 10.222.0.87 () {60 vars in 1291 bytes} [Fri Oct 29 01:21:33 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:36.158971 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi [None req-ad15e823-721b-40ea-a48f-02feb998f5c0 None None] Calling method '>' {{(pid=101149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:36.159972 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: INFO nova.api.openstack.requestlog [None req-ad15e823-721b-40ea-a48f-02feb998f5c0 None None] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001403 Oct 29 01:21:36.160360 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: [pid: 101149|app: 0|req: 3/4] 10.222.0.87 () {54 vars in 930 bytes} [Fri Oct 29 01:21:36 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:21:36.223766 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi [None req-301f6dd1-8e88-45af-8fe7-7f9b437dcf1f admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "disk": 1, "os-flavor-access:is_public": true, "name": "cirros256", "ram": 256, "rxtx_factor": 1.0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=101150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:21:36.244147 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:21:36.244147 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: warnings.warn(msg) Oct 29 01:21:36.349863 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: INFO nova.api.openstack.requestlog [None req-301f6dd1-8e88-45af-8fe7-7f9b437dcf1f admin admin] 10.222.0.87 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.181649 Oct 29 01:21:36.352551 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: [pid: 101150|app: 0|req: 2/5] 10.222.0.87 () {64 vars in 1282 bytes} [Fri Oct 29 01:21:36 2021] POST /compute/v2.1/flavors => generated 407 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:21:36.596742 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi [None req-84b10882-d236-4fb7-b087-4658f23957a7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:21:36.599181 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:21:36.599181 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: warnings.warn(msg) Oct 29 01:21:36.743370 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: INFO nova.api.openstack.requestlog [None req-84b10882-d236-4fb7-b087-4658f23957a7 admin admin] 10.222.0.87 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.384581 Oct 29 01:21:36.744246 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: [pid: 101149|app: 0|req: 4/6] 10.222.0.87 () {64 vars in 1335 bytes} [Fri Oct 29 01:21:36 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:39.102995 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi [None req-301f6dd1-8e88-45af-8fe7-7f9b437dcf1f admin admin] Calling method '>' {{(pid=101150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:39.104142 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: INFO nova.api.openstack.requestlog [None req-301f6dd1-8e88-45af-8fe7-7f9b437dcf1f admin admin] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Oct 29 01:21:39.104738 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: [pid: 101150|app: 0|req: 3/7] 10.222.0.87 () {54 vars in 930 bytes} [Fri Oct 29 01:21:39 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:21:39.232814 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi [None req-7a1c49d4-b359-439e-9647-f4c2ab8c3069 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "name": "ds512M", "vcpus": 1, "os-flavor-access:is_public": true, "ram": 512, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1"}} {{(pid=101149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:21:39.253312 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:21:39.253312 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: warnings.warn(msg) Oct 29 01:21:39.354376 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: INFO nova.api.openstack.requestlog [None req-7a1c49d4-b359-439e-9647-f4c2ab8c3069 admin admin] 10.222.0.87 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.242377 Oct 29 01:21:39.359360 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: [pid: 101149|app: 0|req: 5/8] 10.222.0.87 () {64 vars in 1282 bytes} [Fri Oct 29 01:21:39 2021] POST /compute/v2.1/flavors => generated 404 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 01:21:39.368998 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi [None req-91ed2613-f767-4487-9fc3-e0fa6622d716 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:21:39.370611 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:21:39.370611 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: warnings.warn(msg) Oct 29 01:21:39.495490 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: INFO nova.api.openstack.requestlog [None req-91ed2613-f767-4487-9fc3-e0fa6622d716 admin admin] 10.222.0.87 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.131272 Oct 29 01:21:39.496312 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: [pid: 101150|app: 0|req: 4/9] 10.222.0.87 () {64 vars in 1335 bytes} [Fri Oct 29 01:21:39 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:41.853848 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi [None req-7a1c49d4-b359-439e-9647-f4c2ab8c3069 admin admin] Calling method '>' {{(pid=101149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:41.854775 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: INFO nova.api.openstack.requestlog [None req-7a1c49d4-b359-439e-9647-f4c2ab8c3069 admin admin] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Oct 29 01:21:41.855198 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: [pid: 101149|app: 0|req: 6/10] 10.222.0.87 () {54 vars in 930 bytes} [Fri Oct 29 01:21:41 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:21:41.927802 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi [None req-c252c627-20ad-45d8-902a-9b5267cf78e8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "name": "ds1G", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "disk": 10, "ram": 1024}} {{(pid=101150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:21:42.030954 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: INFO nova.api.openstack.requestlog [None req-c252c627-20ad-45d8-902a-9b5267cf78e8 admin admin] 10.222.0.87 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.168094 Oct 29 01:21:42.031541 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: [pid: 101150|app: 0|req: 5/11] 10.222.0.87 () {64 vars in 1282 bytes} [Fri Oct 29 01:21:41 2021] POST /compute/v2.1/flavors => generated 404 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:21:42.044200 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi [None req-e03556d7-3fd6-4b0e-ad57-f926d409ba9d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:21:42.107942 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: INFO nova.api.openstack.requestlog [None req-e03556d7-3fd6-4b0e-ad57-f926d409ba9d admin admin] 10.222.0.87 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.067292 Oct 29 01:21:42.108830 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: [pid: 101149|app: 0|req: 7/12] 10.222.0.87 () {64 vars in 1335 bytes} [Fri Oct 29 01:21:42 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:44.489007 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi [None req-c252c627-20ad-45d8-902a-9b5267cf78e8 admin admin] Calling method '>' {{(pid=101150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:44.490728 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: INFO nova.api.openstack.requestlog [None req-c252c627-20ad-45d8-902a-9b5267cf78e8 admin admin] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002166 Oct 29 01:21:44.491276 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: [pid: 101150|app: 0|req: 6/13] 10.222.0.87 () {54 vars in 930 bytes} [Fri Oct 29 01:21:44 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:21:44.556320 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi [None req-cefa2fb8-31c2-4ca3-ace0-40c2ac0a2027 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "id": "d3", "swap": 0, "disk": 10, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 2}} {{(pid=101149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:21:44.640855 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: INFO nova.api.openstack.requestlog [None req-cefa2fb8-31c2-4ca3-ace0-40c2ac0a2027 admin admin] 10.222.0.87 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.142484 Oct 29 01:21:44.641338 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: [pid: 101149|app: 0|req: 8/14] 10.222.0.87 () {64 vars in 1282 bytes} [Fri Oct 29 01:21:44 2021] POST /compute/v2.1/flavors => generated 404 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 01:21:44.654743 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi [None req-95d55864-0fa1-4987-b54e-5b8ebd465dbb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:21:44.741794 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: INFO nova.api.openstack.requestlog [None req-95d55864-0fa1-4987-b54e-5b8ebd465dbb admin admin] 10.222.0.87 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.090538 Oct 29 01:21:44.742299 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: [pid: 101150|app: 0|req: 7/15] 10.222.0.87 () {64 vars in 1335 bytes} [Fri Oct 29 01:21:44 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:47.093452 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi [None req-cefa2fb8-31c2-4ca3-ace0-40c2ac0a2027 admin admin] Calling method '>' {{(pid=101149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:47.094454 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: INFO nova.api.openstack.requestlog [None req-cefa2fb8-31c2-4ca3-ace0-40c2ac0a2027 admin admin] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Oct 29 01:21:47.095025 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: [pid: 101149|app: 0|req: 9/16] 10.222.0.87 () {54 vars in 930 bytes} [Fri Oct 29 01:21:47 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:21:47.165491 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi [None req-3927a770-3150-4570-9503-6d3ac2873d63 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "vcpus": 4, "name": "ds4G", "ram": 4096, "rxtx_factor": 1.0, "id": "d4", "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=101150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:21:47.242474 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: INFO nova.api.openstack.requestlog [None req-3927a770-3150-4570-9503-6d3ac2873d63 admin admin] 10.222.0.87 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.139980 Oct 29 01:21:47.243542 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: [pid: 101150|app: 0|req: 8/17] 10.222.0.87 () {64 vars in 1282 bytes} [Fri Oct 29 01:21:47 2021] POST /compute/v2.1/flavors => generated 404 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 01:21:47.256024 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi [None req-8efe1524-a49f-43aa-8afc-a1bed424867a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:21:47.341835 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: INFO nova.api.openstack.requestlog [None req-8efe1524-a49f-43aa-8afc-a1bed424867a admin admin] 10.222.0.87 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.089665 Oct 29 01:21:47.343053 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: [pid: 101149|app: 0|req: 10/18] 10.222.0.87 () {64 vars in 1335 bytes} [Fri Oct 29 01:21:47 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:49.786035 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi [None req-3927a770-3150-4570-9503-6d3ac2873d63 admin admin] Calling method '>' {{(pid=101150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:49.787040 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: INFO nova.api.openstack.requestlog [None req-3927a770-3150-4570-9503-6d3ac2873d63 admin admin] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Oct 29 01:21:49.787427 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: [pid: 101150|app: 0|req: 9/19] 10.222.0.87 () {54 vars in 930 bytes} [Fri Oct 29 01:21:49 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:21:49.862906 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi [None req-481075fc-1dea-4d38-aa44-85eb3bd0eb25 admin admin] Calling method '>' {{(pid=101149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:49.894214 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: INFO nova.api.openstack.requestlog [None req-481075fc-1dea-4d38-aa44-85eb3bd0eb25 admin admin] 10.222.0.87 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.098442 Oct 29 01:21:49.894854 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: [pid: 101149|app: 0|req: 11/20] 10.222.0.87 () {60 vars in 1291 bytes} [Fri Oct 29 01:21:49 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:21:52.465151 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi [None req-3927a770-3150-4570-9503-6d3ac2873d63 admin admin] Calling method '>' {{(pid=101150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:52.466247 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: INFO nova.api.openstack.requestlog [None req-3927a770-3150-4570-9503-6d3ac2873d63 admin admin] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001535 Oct 29 01:21:52.466652 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: [pid: 101150|app: 0|req: 10/21] 10.222.0.87 () {54 vars in 930 bytes} [Fri Oct 29 01:21:52 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:21:52.537101 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi [None req-e78318bd-9ac8-4485-bebf-14c74ae1785b admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 1, "id": "1", "vcpus": 1, "os-flavor-access:is_public": true, "name": "m1.tiny", "ram": 512, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=101149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:21:52.636503 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: INFO nova.api.openstack.requestlog [None req-e78318bd-9ac8-4485-bebf-14c74ae1785b admin admin] 10.222.0.87 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.162718 Oct 29 01:21:52.636985 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: [pid: 101149|app: 0|req: 12/22] 10.222.0.87 () {64 vars in 1282 bytes} [Fri Oct 29 01:21:52 2021] POST /compute/v2.1/flavors => generated 402 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:21:52.649891 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi [None req-7d46a5d9-7b8b-4242-9cd6-fd4913dce316 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:21:52.724273 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: INFO nova.api.openstack.requestlog [None req-7d46a5d9-7b8b-4242-9cd6-fd4913dce316 admin admin] 10.222.0.87 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.077440 Oct 29 01:21:52.724863 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: [pid: 101150|app: 0|req: 11/23] 10.222.0.87 () {64 vars in 1332 bytes} [Fri Oct 29 01:21:52 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:55.048232 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi [None req-e78318bd-9ac8-4485-bebf-14c74ae1785b admin admin] Calling method '>' {{(pid=101149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:55.049230 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: INFO nova.api.openstack.requestlog [None req-e78318bd-9ac8-4485-bebf-14c74ae1785b admin admin] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Oct 29 01:21:55.049792 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: [pid: 101149|app: 0|req: 13/24] 10.222.0.87 () {54 vars in 930 bytes} [Fri Oct 29 01:21:55 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:21:55.110592 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi [None req-2097cbff-88ba-4765-8642-d84b65c14590 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "rxtx_factor": 1.0, "ram": 2048, "swap": 0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "os-flavor-access:is_public": true, "name": "m1.small"}} {{(pid=101150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:21:55.215668 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: INFO nova.api.openstack.requestlog [None req-2097cbff-88ba-4765-8642-d84b65c14590 admin admin] 10.222.0.87 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.158393 Oct 29 01:21:55.216205 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: [pid: 101150|app: 0|req: 12/25] 10.222.0.87 () {64 vars in 1282 bytes} [Fri Oct 29 01:21:55 2021] POST /compute/v2.1/flavors => generated 405 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:21:55.229490 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi [None req-bab57fdd-9b73-4c87-8414-67bfb691f502 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:21:55.307685 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: INFO nova.api.openstack.requestlog [None req-bab57fdd-9b73-4c87-8414-67bfb691f502 admin admin] 10.222.0.87 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.081738 Oct 29 01:21:55.308672 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: [pid: 101149|app: 0|req: 14/26] 10.222.0.87 () {64 vars in 1332 bytes} [Fri Oct 29 01:21:55 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:21:57.689396 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi [None req-2097cbff-88ba-4765-8642-d84b65c14590 admin admin] Calling method '>' {{(pid=101150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:21:57.690404 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: INFO nova.api.openstack.requestlog [None req-2097cbff-88ba-4765-8642-d84b65c14590 admin admin] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Oct 29 01:21:57.691009 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: [pid: 101150|app: 0|req: 13/27] 10.222.0.87 () {54 vars in 930 bytes} [Fri Oct 29 01:21:57 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:21:57.751031 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi [None req-6f00468d-ccb1-45b0-b675-2e24dda7edb6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "vcpus": 2, "ram": 4096, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "id": "3", "name": "m1.medium"}} {{(pid=101149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:21:57.906072 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: INFO nova.api.openstack.requestlog [None req-6f00468d-ccb1-45b0-b675-2e24dda7edb6 admin admin] 10.222.0.87 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.207622 Oct 29 01:21:57.906628 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: [pid: 101149|app: 0|req: 15/28] 10.222.0.87 () {64 vars in 1282 bytes} [Fri Oct 29 01:21:57 2021] POST /compute/v2.1/flavors => generated 406 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:21:57.921059 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi [None req-f544c624-70bb-4af5-8b4e-f4dfc8a6ebd0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:21:58.008405 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: INFO nova.api.openstack.requestlog [None req-f544c624-70bb-4af5-8b4e-f4dfc8a6ebd0 admin admin] 10.222.0.87 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091543 Oct 29 01:21:58.009213 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: [pid: 101150|app: 0|req: 14/29] 10.222.0.87 () {64 vars in 1332 bytes} [Fri Oct 29 01:21:57 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:00.446343 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi [None req-6f00468d-ccb1-45b0-b675-2e24dda7edb6 admin admin] Calling method '>' {{(pid=101149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:00.448128 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: INFO nova.api.openstack.requestlog [None req-6f00468d-ccb1-45b0-b675-2e24dda7edb6 admin admin] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002175 Oct 29 01:22:00.448746 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: [pid: 101149|app: 0|req: 16/30] 10.222.0.87 () {54 vars in 930 bytes} [Fri Oct 29 01:22:00 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:22:00.513400 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi [None req-e515b418-e659-4065-80c2-244cc8c79a28 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 4, "disk": 80, "name": "m1.large", "rxtx_factor": 1.0, "id": "4"}} {{(pid=101150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:22:00.587450 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: INFO nova.api.openstack.requestlog [None req-e515b418-e659-4065-80c2-244cc8c79a28 admin admin] 10.222.0.87 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.131544 Oct 29 01:22:00.588041 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: [pid: 101150|app: 0|req: 15/31] 10.222.0.87 () {64 vars in 1282 bytes} [Fri Oct 29 01:22:00 2021] POST /compute/v2.1/flavors => generated 405 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 01:22:00.600815 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi [None req-225c0d33-434d-4439-8683-257ab4ad2fd3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:22:00.697361 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: INFO nova.api.openstack.requestlog [None req-225c0d33-434d-4439-8683-257ab4ad2fd3 admin admin] 10.222.0.87 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.100199 Oct 29 01:22:00.707804 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: [pid: 101149|app: 0|req: 17/32] 10.222.0.87 () {64 vars in 1332 bytes} [Fri Oct 29 01:22:00 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:03.083618 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi [None req-e515b418-e659-4065-80c2-244cc8c79a28 admin admin] Calling method '>' {{(pid=101150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:03.084653 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: INFO nova.api.openstack.requestlog [None req-e515b418-e659-4065-80c2-244cc8c79a28 admin admin] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Oct 29 01:22:03.085252 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: [pid: 101150|app: 0|req: 16/33] 10.222.0.87 () {54 vars in 930 bytes} [Fri Oct 29 01:22:03 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:22:03.150645 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi [None req-fd629f1c-c5a4-410a-bf12-c170172dd2f8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 8, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 16384, "id": "5", "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160}} {{(pid=101149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:22:03.223689 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: INFO nova.api.openstack.requestlog [None req-fd629f1c-c5a4-410a-bf12-c170172dd2f8 admin admin] 10.222.0.87 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.130892 Oct 29 01:22:03.226268 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: [pid: 101149|app: 0|req: 18/34] 10.222.0.87 () {64 vars in 1282 bytes} [Fri Oct 29 01:22:03 2021] POST /compute/v2.1/flavors => generated 408 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:22:03.237385 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi [None req-8f78fdf2-35ef-442e-b5ef-41cb129266fd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:22:03.326294 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: INFO nova.api.openstack.requestlog [None req-8f78fdf2-35ef-442e-b5ef-41cb129266fd admin admin] 10.222.0.87 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.093085 Oct 29 01:22:03.340026 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: [pid: 101150|app: 0|req: 17/35] 10.222.0.87 () {64 vars in 1332 bytes} [Fri Oct 29 01:22:03 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:22:43.962888 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi [None req-fd629f1c-c5a4-410a-bf12-c170172dd2f8 admin admin] Calling method '>' {{(pid=101149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:43.963915 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: INFO nova.api.openstack.requestlog [None req-fd629f1c-c5a4-410a-bf12-c170172dd2f8 admin admin] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Oct 29 01:22:43.964317 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: [pid: 101149|app: 0|req: 19/36] 10.222.0.87 () {54 vars in 930 bytes} [Fri Oct 29 01:22:43 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:22:44.023119 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi [None req-71c2d3ae-fa49-4540-8f1e-398746319455 admin admin] Calling method '>' {{(pid=101150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:44.040069 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: INFO nova.api.openstack.requestlog [None req-71c2d3ae-fa49-4540-8f1e-398746319455 admin admin] 10.222.0.87 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.069058 Oct 29 01:22:44.040604 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: [pid: 101150|app: 0|req: 18/37] 10.222.0.87 () {60 vars in 1291 bytes} [Fri Oct 29 01:22:43 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:22:45.580214 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi [None req-fd629f1c-c5a4-410a-bf12-c170172dd2f8 admin admin] Calling method '>' {{(pid=101149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:45.581829 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: INFO nova.api.openstack.requestlog [None req-fd629f1c-c5a4-410a-bf12-c170172dd2f8 admin admin] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002120 Oct 29 01:22:45.582226 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: [pid: 101149|app: 0|req: 20/38] 10.222.0.87 () {56 vars in 1074 bytes} [Fri Oct 29 01:22:45 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:22:45.773551 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi [None req-39004d46-86d1-41f5-b531-74dce434c2f5 admin admin] Calling method '>' {{(pid=101150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:45.779006 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: INFO nova.api.openstack.wsgi [None req-39004d46-86d1-41f5-b531-74dce434c2f5 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 29 01:22:45.779562 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi [None req-39004d46-86d1-41f5-b531-74dce434c2f5 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101150) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:22:45.780389 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: INFO nova.api.openstack.requestlog [None req-39004d46-86d1-41f5-b531-74dce434c2f5 admin admin] 10.222.0.87 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.057779 Oct 29 01:22:45.780896 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: [pid: 101150|app: 0|req: 19/39] 10.222.0.87 () {60 vars in 1190 bytes} [Fri Oct 29 01:22:45 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 29 01:22:45.791417 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi [None req-828952ca-c404-4951-8da5-610fb5278f86 admin admin] Calling method '>' {{(pid=101149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:45.811401 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: INFO nova.api.openstack.requestlog [None req-828952ca-c404-4951-8da5-610fb5278f86 admin admin] 10.222.0.87 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023509 Oct 29 01:22:45.811967 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: [pid: 101149|app: 0|req: 21/40] 10.222.0.87 () {60 vars in 1210 bytes} [Fri Oct 29 01:22:45 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:22:45.822699 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi [None req-00dd337d-4930-4761-b34b-11085d89bf2d admin admin] Calling method '>' {{(pid=101150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:45.844351 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: INFO nova.api.openstack.requestlog [None req-00dd337d-4930-4761-b34b-11085d89bf2d admin admin] 10.222.0.87 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025069 Oct 29 01:22:45.844882 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: [pid: 101150|app: 0|req: 20/41] 10.222.0.87 () {60 vars in 1210 bytes} [Fri Oct 29 01:22:45 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:22:45.854911 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi [None req-e6d76092-7896-4214-9af6-7c68bc0f6cfe admin admin] Calling method '>' {{(pid=101149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:45.860350 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: INFO nova.api.openstack.wsgi [None req-e6d76092-7896-4214-9af6-7c68bc0f6cfe admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 29 01:22:45.860905 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi [None req-e6d76092-7896-4214-9af6-7c68bc0f6cfe admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101149) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:22:45.861685 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: INFO nova.api.openstack.requestlog [None req-e6d76092-7896-4214-9af6-7c68bc0f6cfe admin admin] 10.222.0.87 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010443 Oct 29 01:22:45.862166 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: [pid: 101149|app: 0|req: 22/42] 10.222.0.87 () {60 vars in 1190 bytes} [Fri Oct 29 01:22:45 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 29 01:22:47.284394 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi [None req-00dd337d-4930-4761-b34b-11085d89bf2d admin admin] Calling method '>' {{(pid=101150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:47.285396 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: INFO nova.api.openstack.requestlog [None req-00dd337d-4930-4761-b34b-11085d89bf2d admin admin] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001540 Oct 29 01:22:47.285790 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: [pid: 101150|app: 0|req: 21/43] 10.222.0.87 () {56 vars in 1074 bytes} [Fri Oct 29 01:22:47 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:22:47.478561 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi [None req-e0d881dc-30d1-4a99-b3c8-b2960f81afc1 admin admin] Calling method '>' {{(pid=101149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:47.484322 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: INFO nova.api.openstack.wsgi [None req-e0d881dc-30d1-4a99-b3c8-b2960f81afc1 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 29 01:22:47.484892 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi [None req-e0d881dc-30d1-4a99-b3c8-b2960f81afc1 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101149) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:22:47.485692 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: INFO nova.api.openstack.requestlog [None req-e0d881dc-30d1-4a99-b3c8-b2960f81afc1 admin admin] 10.222.0.87 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.059045 Oct 29 01:22:47.486210 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: [pid: 101149|app: 0|req: 23/44] 10.222.0.87 () {60 vars in 1190 bytes} [Fri Oct 29 01:22:47 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 29 01:22:47.496675 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi [None req-79573875-5d80-4619-a2d8-9824e7b5fde7 admin admin] Calling method '>' {{(pid=101150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:47.510153 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: INFO nova.api.openstack.requestlog [None req-79573875-5d80-4619-a2d8-9824e7b5fde7 admin admin] 10.222.0.87 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017020 Oct 29 01:22:47.510701 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: [pid: 101150|app: 0|req: 22/45] 10.222.0.87 () {60 vars in 1210 bytes} [Fri Oct 29 01:22:47 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:22:47.521452 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi [None req-391999ce-3a18-458f-87b7-d4a82570207c admin admin] Calling method '>' {{(pid=101149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:47.536052 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: INFO nova.api.openstack.requestlog [None req-391999ce-3a18-458f-87b7-d4a82570207c admin admin] 10.222.0.87 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018602 Oct 29 01:22:47.536608 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: [pid: 101149|app: 0|req: 24/46] 10.222.0.87 () {60 vars in 1210 bytes} [Fri Oct 29 01:22:47 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:22:47.546625 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi [None req-8b415aac-ecbe-4557-b973-4535ada9dbd4 admin admin] Calling method '>' {{(pid=101150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:47.552686 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: INFO nova.api.openstack.wsgi [None req-8b415aac-ecbe-4557-b973-4535ada9dbd4 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 29 01:22:47.553246 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi [None req-8b415aac-ecbe-4557-b973-4535ada9dbd4 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101150) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:22:47.554028 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: INFO nova.api.openstack.requestlog [None req-8b415aac-ecbe-4557-b973-4535ada9dbd4 admin admin] 10.222.0.87 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011017 Oct 29 01:22:47.554526 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: [pid: 101150|app: 0|req: 23/47] 10.222.0.87 () {60 vars in 1190 bytes} [Fri Oct 29 01:22:47 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 29 01:22:48.974315 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi [None req-391999ce-3a18-458f-87b7-d4a82570207c admin admin] Calling method '>' {{(pid=101149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:48.975342 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: INFO nova.api.openstack.requestlog [None req-391999ce-3a18-458f-87b7-d4a82570207c admin admin] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Oct 29 01:22:48.975759 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: [pid: 101149|app: 0|req: 25/48] 10.222.0.87 () {56 vars in 1074 bytes} [Fri Oct 29 01:22:48 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:22:49.170798 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi [None req-21e39f21-384f-4109-aac8-3624becf3d9f admin admin] Calling method '>' {{(pid=101150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:49.176349 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: INFO nova.api.openstack.wsgi [None req-21e39f21-384f-4109-aac8-3624becf3d9f admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 29 01:22:49.176922 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi [None req-21e39f21-384f-4109-aac8-3624becf3d9f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101150) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:22:49.177707 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: INFO nova.api.openstack.requestlog [None req-21e39f21-384f-4109-aac8-3624becf3d9f admin admin] 10.222.0.87 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.060729 Oct 29 01:22:49.178296 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: [pid: 101150|app: 0|req: 24/49] 10.222.0.87 () {60 vars in 1193 bytes} [Fri Oct 29 01:22:49 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 29 01:22:49.188143 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi [None req-0efdcc67-80c8-4010-be51-0520093e9809 admin admin] Calling method '>' {{(pid=101149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:49.203689 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: INFO nova.api.openstack.requestlog [None req-0efdcc67-80c8-4010-be51-0520093e9809 admin admin] 10.222.0.87 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019022 Oct 29 01:22:49.204254 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: [pid: 101149|app: 0|req: 26/50] 10.222.0.87 () {60 vars in 1210 bytes} [Fri Oct 29 01:22:49 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:22:49.215469 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi [None req-c5b83752-7c8c-4202-8542-f60652bed6da admin admin] Calling method '>' {{(pid=101150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:49.229111 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: INFO nova.api.openstack.requestlog [None req-c5b83752-7c8c-4202-8542-f60652bed6da admin admin] 10.222.0.87 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017185 Oct 29 01:22:49.229654 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: [pid: 101150|app: 0|req: 25/51] 10.222.0.87 () {60 vars in 1210 bytes} [Fri Oct 29 01:22:49 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:22:49.240374 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi [None req-3a0221cf-30bb-41c5-ab14-fdbd9f923dd9 admin admin] Calling method '>' {{(pid=101149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:49.245631 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: INFO nova.api.openstack.wsgi [None req-3a0221cf-30bb-41c5-ab14-fdbd9f923dd9 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 29 01:22:49.246193 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi [None req-3a0221cf-30bb-41c5-ab14-fdbd9f923dd9 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101149) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:22:49.247019 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: INFO nova.api.openstack.requestlog [None req-3a0221cf-30bb-41c5-ab14-fdbd9f923dd9 admin admin] 10.222.0.87 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010789 Oct 29 01:22:49.247535 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: [pid: 101149|app: 0|req: 27/52] 10.222.0.87 () {60 vars in 1193 bytes} [Fri Oct 29 01:22:49 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 29 01:22:50.675548 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi [None req-c5b83752-7c8c-4202-8542-f60652bed6da admin admin] Calling method '>' {{(pid=101150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:50.676566 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: INFO nova.api.openstack.requestlog [None req-c5b83752-7c8c-4202-8542-f60652bed6da admin admin] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Oct 29 01:22:50.676958 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: [pid: 101150|app: 0|req: 26/53] 10.222.0.87 () {56 vars in 1074 bytes} [Fri Oct 29 01:22:50 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:22:50.868231 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi [None req-782ecba5-edb1-40e9-b679-5a13d4cd1a07 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:22:50.951504 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: INFO nova.api.openstack.requestlog [None req-782ecba5-edb1-40e9-b679-5a13d4cd1a07 admin admin] 10.222.0.87 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.134473 Oct 29 01:22:50.951993 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: [pid: 101149|app: 0|req: 28/54] 10.222.0.87 () {64 vars in 1235 bytes} [Fri Oct 29 01:22:50 2021] POST /compute/v2.1/flavors => generated 404 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:22:52.374236 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi [None req-c5b83752-7c8c-4202-8542-f60652bed6da admin admin] Calling method '>' {{(pid=101150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:52.375233 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: INFO nova.api.openstack.requestlog [None req-c5b83752-7c8c-4202-8542-f60652bed6da admin admin] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Oct 29 01:22:52.375630 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: [pid: 101150|app: 0|req: 27/55] 10.222.0.87 () {56 vars in 1074 bytes} [Fri Oct 29 01:22:52 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:22:52.571310 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi [None req-3879618b-08a8-41f5-b4d9-bbd13ec1d5d7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:22:52.654171 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: INFO nova.api.openstack.requestlog [None req-3879618b-08a8-41f5-b4d9-bbd13ec1d5d7 admin admin] 10.222.0.87 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.137026 Oct 29 01:22:52.655017 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: [pid: 101149|app: 0|req: 29/56] 10.222.0.87 () {64 vars in 1235 bytes} [Fri Oct 29 01:22:52 2021] POST /compute/v2.1/flavors => generated 405 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:22:54.089913 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi [None req-c5b83752-7c8c-4202-8542-f60652bed6da admin admin] Calling method '>' {{(pid=101150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:54.090906 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: INFO nova.api.openstack.requestlog [None req-c5b83752-7c8c-4202-8542-f60652bed6da admin admin] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 Oct 29 01:22:54.091295 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: [pid: 101150|app: 0|req: 28/57] 10.222.0.87 () {56 vars in 1074 bytes} [Fri Oct 29 01:22:54 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:22:54.284436 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi [None req-661ac51e-d710-4e34-b588-d472df48a80c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:22:54.371553 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: INFO nova.api.openstack.requestlog [None req-661ac51e-d710-4e34-b588-d472df48a80c admin admin] 10.222.0.87 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.138852 Oct 29 01:22:54.372139 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: [pid: 101149|app: 0|req: 30/58] 10.222.0.87 () {64 vars in 1235 bytes} [Fri Oct 29 01:22:54 2021] POST /compute/v2.1/flavors => generated 407 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:22:55.810851 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi [None req-c5b83752-7c8c-4202-8542-f60652bed6da admin admin] Calling method '>' {{(pid=101150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:55.811930 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: INFO nova.api.openstack.requestlog [None req-c5b83752-7c8c-4202-8542-f60652bed6da admin admin] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Oct 29 01:22:55.812325 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: [pid: 101150|app: 0|req: 29/59] 10.222.0.87 () {56 vars in 1074 bytes} [Fri Oct 29 01:22:55 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:22:56.011530 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi [None req-a1e1a430-18fb-4ac8-b8ec-35b15066d55d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:22:56.090415 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: INFO nova.api.openstack.requestlog [None req-a1e1a430-18fb-4ac8-b8ec-35b15066d55d admin admin] 10.222.0.87 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.132054 Oct 29 01:22:56.090968 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: [pid: 101149|app: 0|req: 31/60] 10.222.0.87 () {64 vars in 1235 bytes} [Fri Oct 29 01:22:55 2021] POST /compute/v2.1/flavors => generated 409 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 01:22:57.550990 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi [None req-c5b83752-7c8c-4202-8542-f60652bed6da admin admin] Calling method '>' {{(pid=101150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:57.552003 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: INFO nova.api.openstack.requestlog [None req-c5b83752-7c8c-4202-8542-f60652bed6da admin admin] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Oct 29 01:22:57.552408 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: [pid: 101150|app: 0|req: 30/61] 10.222.0.87 () {56 vars in 1074 bytes} [Fri Oct 29 01:22:57 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:22:57.743001 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi [None req-83407fbd-b003-40f8-81a6-1f15bcadce3f admin admin] Calling method '>' {{(pid=101149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:22:57.762439 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: INFO nova.api.openstack.requestlog [None req-83407fbd-b003-40f8-81a6-1f15bcadce3f admin admin] 10.222.0.87 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.071774 Oct 29 01:22:57.762909 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: [pid: 101149|app: 0|req: 32/62] 10.222.0.87 () {60 vars in 1202 bytes} [Fri Oct 29 01:22:57 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:23:45.178890 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi [None req-c5b83752-7c8c-4202-8542-f60652bed6da admin admin] Calling method '>' {{(pid=101150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:45.179949 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: INFO nova.api.openstack.requestlog [None req-c5b83752-7c8c-4202-8542-f60652bed6da admin admin] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Oct 29 01:23:45.180355 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: [pid: 101150|app: 0|req: 31/63] 10.222.0.87 () {54 vars in 930 bytes} [Fri Oct 29 01:23:45 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:23:45.246103 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi [None req-7cb4cc2d-09ca-4d3e-ae89-b4bb1af51200 admin admin] Calling method '>' {{(pid=101149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:45.265004 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: INFO nova.api.openstack.requestlog [None req-7cb4cc2d-09ca-4d3e-ae89-b4bb1af51200 admin admin] 10.222.0.87 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.078015 Oct 29 01:23:45.265747 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: [pid: 101149|app: 0|req: 33/64] 10.222.0.87 () {60 vars in 1291 bytes} [Fri Oct 29 01:23:45 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:23:45.289248 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi [None req-eb8a4bcd-f78c-40ec-8a77-35118f1bdf3e admin admin] Calling method '>' {{(pid=101150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:45.298139 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: INFO nova.api.openstack.requestlog [None req-eb8a4bcd-f78c-40ec-8a77-35118f1bdf3e admin admin] 10.222.0.87 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012407 Oct 29 01:23:45.298714 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: [pid: 101150|app: 0|req: 32/65] 10.222.0.87 () {60 vars in 1282 bytes} [Fri Oct 29 01:23:45 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:45.311397 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi [None req-c6c50864-328a-4cd4-be02-883ed388538a admin admin] Calling method '>' {{(pid=101149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:45.319516 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: INFO nova.api.openstack.requestlog [None req-c6c50864-328a-4cd4-be02-883ed388538a admin admin] 10.222.0.87 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011704 Oct 29 01:23:45.320108 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: [pid: 101149|app: 0|req: 34/66] 10.222.0.87 () {60 vars in 1285 bytes} [Fri Oct 29 01:23:45 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:45.332857 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi [None req-0968cf48-6947-4814-82e0-626e3ca9f638 admin admin] Calling method '>' {{(pid=101150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:45.340840 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: INFO nova.api.openstack.requestlog [None req-0968cf48-6947-4814-82e0-626e3ca9f638 admin admin] 10.222.0.87 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011464 Oct 29 01:23:45.341408 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: [pid: 101150|app: 0|req: 33/67] 10.222.0.87 () {60 vars in 1285 bytes} [Fri Oct 29 01:23:45 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:23:45.354795 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi [None req-79851522-be86-476f-bc22-806612634d69 admin admin] Calling method '>' {{(pid=101149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:23:45.363856 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: INFO nova.api.openstack.requestlog [None req-79851522-be86-476f-bc22-806612634d69 admin admin] 10.222.0.87 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012611 Oct 29 01:23:45.364429 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: [pid: 101149|app: 0|req: 35/68] 10.222.0.87 () {60 vars in 1282 bytes} [Fri Oct 29 01:23:45 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:25:31.497385 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi [None req-9ea34d5b-b4a4-4fcd-b59c-763d46d62066 tempest-verify_tempest_config-147611766 tempest-verify_tempest_config-147611766-project] Calling method '>' {{(pid=101150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:25:31.499372 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: INFO nova.api.openstack.requestlog [None req-9ea34d5b-b4a4-4fcd-b59c-763d46d62066 tempest-verify_tempest_config-147611766 tempest-verify_tempest_config-147611766-project] 10.222.0.87 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.108916 Oct 29 01:25:31.499963 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: [pid: 101150|app: 0|req: 34/69] 10.222.0.87 () {58 vars in 1133 bytes} [Fri Oct 29 01:25:31 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:27:06.048136 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi [None req-79851522-be86-476f-bc22-806612634d69 admin admin] Calling method '>' {{(pid=101149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:27:06.049140 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: INFO nova.api.openstack.requestlog [None req-79851522-be86-476f-bc22-806612634d69 admin admin] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Oct 29 01:27:06.049562 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: [pid: 101149|app: 0|req: 36/70] 10.222.0.87 () {56 vars in 1074 bytes} [Fri Oct 29 01:27:06 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:27:06.361629 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi [None req-6230d15a-0946-4941-b3d5-1c225d02a014 admin admin] Calling method '>' {{(pid=101150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:27:06.362792 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:27:06.362792 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: warnings.warn(msg) Oct 29 01:27:06.364355 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG oslo_concurrency.lockutils [None req-6230d15a-0946-4941-b3d5-1c225d02a014 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:27:06.364992 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG oslo_concurrency.lockutils [None req-6230d15a-0946-4941-b3d5-1c225d02a014 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:27:06.366314 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG oslo_concurrency.lockutils [None req-6230d15a-0946-4941-b3d5-1c225d02a014 admin admin] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:27:06.366314 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG oslo_concurrency.lockutils [None req-6230d15a-0946-4941-b3d5-1c225d02a014 admin admin] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:27:06.400727 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: INFO nova.api.openstack.requestlog [None req-6230d15a-0946-4941-b3d5-1c225d02a014 admin admin] 10.222.0.87 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.187194 Oct 29 01:27:06.401310 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: [pid: 101150|app: 0|req: 35/71] 10.222.0.87 () {60 vars in 1193 bytes} [Fri Oct 29 01:27:06 2021] GET /compute/v2.1/os-services => generated 791 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:27:07.848960 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi [None req-79851522-be86-476f-bc22-806612634d69 admin admin] Calling method '>' {{(pid=101149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:27:07.849955 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: INFO nova.api.openstack.requestlog [None req-79851522-be86-476f-bc22-806612634d69 admin admin] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001404 Oct 29 01:27:07.850355 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: [pid: 101149|app: 0|req: 37/72] 10.222.0.87 () {56 vars in 1074 bytes} [Fri Oct 29 01:27:07 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:27:08.045478 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi [None req-d815bc97-ad26-4143-9974-8fb74ef7c0c2 admin admin] Calling method '>' {{(pid=101150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:27:08.046658 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:27:08.046658 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: warnings.warn(msg) Oct 29 01:27:08.048178 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG oslo_concurrency.lockutils [None req-d815bc97-ad26-4143-9974-8fb74ef7c0c2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:27:08.048608 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG oslo_concurrency.lockutils [None req-d815bc97-ad26-4143-9974-8fb74ef7c0c2 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:27:08.049396 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG oslo_concurrency.lockutils [None req-d815bc97-ad26-4143-9974-8fb74ef7c0c2 admin admin] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:27:08.049814 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG oslo_concurrency.lockutils [None req-d815bc97-ad26-4143-9974-8fb74ef7c0c2 admin admin] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:27:08.068815 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: INFO nova.api.openstack.requestlog [None req-d815bc97-ad26-4143-9974-8fb74ef7c0c2 admin admin] 10.222.0.87 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.077149 Oct 29 01:27:08.069290 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: [pid: 101150|app: 0|req: 36/73] 10.222.0.87 () {60 vars in 1193 bytes} [Fri Oct 29 01:27:07 2021] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:27:20.008871 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi [None req-79851522-be86-476f-bc22-806612634d69 admin admin] Calling method '>' {{(pid=101149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:27:20.009968 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: INFO nova.api.openstack.requestlog [None req-79851522-be86-476f-bc22-806612634d69 admin admin] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001537 Oct 29 01:27:20.010428 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: [pid: 101149|app: 0|req: 38/74] 10.222.0.87 () {56 vars in 1074 bytes} [Fri Oct 29 01:27:20 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:27:20.204285 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi [None req-c3542afc-af7f-4c34-aa50-a83c5e4a52ae admin admin] Calling method '>' {{(pid=101150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:27:20.205514 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:27:20.205514 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: warnings.warn(msg) Oct 29 01:27:20.207038 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG oslo_concurrency.lockutils [None req-c3542afc-af7f-4c34-aa50-a83c5e4a52ae admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:27:20.207493 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG oslo_concurrency.lockutils [None req-c3542afc-af7f-4c34-aa50-a83c5e4a52ae admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:27:20.208454 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG oslo_concurrency.lockutils [None req-c3542afc-af7f-4c34-aa50-a83c5e4a52ae admin admin] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:27:20.208883 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG oslo_concurrency.lockutils [None req-c3542afc-af7f-4c34-aa50-a83c5e4a52ae admin admin] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:27:20.234479 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: INFO nova.api.openstack.requestlog [None req-c3542afc-af7f-4c34-aa50-a83c5e4a52ae admin admin] 10.222.0.87 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.083483 Oct 29 01:27:20.235067 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: [pid: 101150|app: 0|req: 37/75] 10.222.0.87 () {60 vars in 1193 bytes} [Fri Oct 29 01:27:20 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:27:21.672903 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: DEBUG nova.api.openstack.wsgi [None req-79851522-be86-476f-bc22-806612634d69 admin admin] Calling method '>' {{(pid=101149) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:27:21.673894 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: INFO nova.api.openstack.requestlog [None req-79851522-be86-476f-bc22-806612634d69 admin admin] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001405 Oct 29 01:27:21.674286 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: [pid: 101149|app: 0|req: 39/76] 10.222.0.87 () {56 vars in 1074 bytes} [Fri Oct 29 01:27:21 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:27:21.866630 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG nova.api.openstack.wsgi [None req-cd7c37e5-a679-4e95-85e1-ea2249add52a admin admin] Calling method '>' {{(pid=101150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:27:21.867809 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:27:21.867809 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: warnings.warn(msg) Oct 29 01:27:21.869317 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG oslo_concurrency.lockutils [None req-cd7c37e5-a679-4e95-85e1-ea2249add52a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:27:21.869809 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG oslo_concurrency.lockutils [None req-cd7c37e5-a679-4e95-85e1-ea2249add52a admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:27:21.870733 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG oslo_concurrency.lockutils [None req-cd7c37e5-a679-4e95-85e1-ea2249add52a admin admin] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:27:21.871152 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: DEBUG oslo_concurrency.lockutils [None req-cd7c37e5-a679-4e95-85e1-ea2249add52a admin admin] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:27:21.892706 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: INFO nova.api.openstack.requestlog [None req-cd7c37e5-a679-4e95-85e1-ea2249add52a admin admin] 10.222.0.87 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.078294 Oct 29 01:27:21.893195 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: [pid: 101150|app: 0|req: 38/77] 10.222.0.87 () {60 vars in 1193 bytes} [Fri Oct 29 01:27:21 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:28:19.580931 dv-cinder-813984-5-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Oct 29 01:28:19.581649 dv-cinder-813984-5-iscsi devstack@n-api.service[101148]: Fri Oct 29 01:28:19 2021 - graceful shutdown triggered... Oct 29 01:28:19.582080 dv-cinder-813984-5-iscsi devstack@n-api.service[101149]: Gracefully killing worker 1 (pid: 101149)... Oct 29 01:28:19.582436 dv-cinder-813984-5-iscsi devstack@n-api.service[101150]: Gracefully killing worker 2 (pid: 101150)... Oct 29 01:28:20.581995 dv-cinder-813984-5-iscsi devstack@n-api.service[101148]: worker 1 buried after 1 seconds Oct 29 01:28:20.581995 dv-cinder-813984-5-iscsi devstack@n-api.service[101148]: worker 2 buried after 1 seconds Oct 29 01:28:20.581995 dv-cinder-813984-5-iscsi devstack@n-api.service[101148]: goodbye to uWSGI. Oct 29 01:28:20.584227 dv-cinder-813984-5-iscsi systemd[1]: devstack@n-api.service: Succeeded. Oct 29 01:28:20.584842 dv-cinder-813984-5-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Oct 29 01:28:20.587794 dv-cinder-813984-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 29 01:28:20.597168 dv-cinder-813984-5-iscsi devstack@n-api.service[116361]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 29 01:28:20.599276 dv-cinder-813984-5-iscsi devstack@n-api.service[116361]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Oct 29 01:28:20 2021] *** Oct 29 01:28:20.599276 dv-cinder-813984-5-iscsi devstack@n-api.service[116361]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 29 01:28:20.599276 dv-cinder-813984-5-iscsi devstack@n-api.service[116361]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 29 01:28:20.599276 dv-cinder-813984-5-iscsi devstack@n-api.service[116361]: nodename: dv-cinder-813984-5-iscsi Oct 29 01:28:20.599276 dv-cinder-813984-5-iscsi devstack@n-api.service[116361]: machine: x86_64 Oct 29 01:28:20.599276 dv-cinder-813984-5-iscsi devstack@n-api.service[116361]: clock source: unix Oct 29 01:28:20.599276 dv-cinder-813984-5-iscsi devstack@n-api.service[116361]: pcre jit disabled Oct 29 01:28:20.599276 dv-cinder-813984-5-iscsi devstack@n-api.service[116361]: detected number of CPU cores: 4 Oct 29 01:28:20.599276 dv-cinder-813984-5-iscsi devstack@n-api.service[116361]: current working directory: / Oct 29 01:28:20.599276 dv-cinder-813984-5-iscsi devstack@n-api.service[116361]: detected binary path: /usr/bin/uwsgi-core Oct 29 01:28:20.599276 dv-cinder-813984-5-iscsi devstack@n-api.service[116361]: your processes number limit is 47680 Oct 29 01:28:20.599276 dv-cinder-813984-5-iscsi devstack@n-api.service[116361]: your memory page size is 4096 bytes Oct 29 01:28:20.599276 dv-cinder-813984-5-iscsi devstack@n-api.service[116361]: detected max file descriptor number: 2048 Oct 29 01:28:20.599276 dv-cinder-813984-5-iscsi devstack@n-api.service[116361]: lock engine: pthread robust mutexes Oct 29 01:28:20.599276 dv-cinder-813984-5-iscsi devstack@n-api.service[116361]: thunder lock: enabled Oct 29 01:28:20.599276 dv-cinder-813984-5-iscsi devstack@n-api.service[116361]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 29 01:28:20.599276 dv-cinder-813984-5-iscsi devstack@n-api.service[116361]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Oct 29 01:28:20.644430 dv-cinder-813984-5-iscsi devstack@n-api.service[116361]: Python main interpreter initialized at 0x5640782e19c0 Oct 29 01:28:20.644430 dv-cinder-813984-5-iscsi devstack@n-api.service[116361]: python threads support enabled Oct 29 01:28:20.644430 dv-cinder-813984-5-iscsi devstack@n-api.service[116361]: your server socket listen backlog is limited to 100 connections Oct 29 01:28:20.644430 dv-cinder-813984-5-iscsi devstack@n-api.service[116361]: your mercy for graceful operations on workers is 90 seconds Oct 29 01:28:20.644881 dv-cinder-813984-5-iscsi devstack@n-api.service[116361]: mapped 403077 bytes (393 KB) for 2 cores Oct 29 01:28:20.644881 dv-cinder-813984-5-iscsi devstack@n-api.service[116361]: *** Operational MODE: preforking *** Oct 29 01:28:20.645160 dv-cinder-813984-5-iscsi devstack@n-api.service[116361]: *** uWSGI is running in multiple interpreter mode *** Oct 29 01:28:20.645160 dv-cinder-813984-5-iscsi devstack@n-api.service[116361]: spawned uWSGI master process (pid: 116361) Oct 29 01:28:20.645360 dv-cinder-813984-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 29 01:28:20.646607 dv-cinder-813984-5-iscsi devstack@n-api.service[116361]: spawned uWSGI worker 1 (pid: 116378, cores: 1) Oct 29 01:28:20.647125 dv-cinder-813984-5-iscsi devstack@n-api.service[116361]: spawned uWSGI worker 2 (pid: 116379, cores: 1) Oct 29 01:28:20.647478 dv-cinder-813984-5-iscsi devstack@n-api.service[116361]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 29 01:28:22.485867 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 29 01:28:22.485867 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: from cryptography.utils import int_from_bytes Oct 29 01:28:22.486610 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 29 01:28:22.486610 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: from cryptography.utils import int_from_bytes Oct 29 01:28:22.562806 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 29 01:28:22.562806 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: from cryptography.utils import int_from_bytes Oct 29 01:28:22.563482 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 29 01:28:22.563482 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: from cryptography.utils import int_from_bytes Oct 29 01:28:25.050761 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 29 01:28:25.051333 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 29 01:28:25.051530 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 29 01:28:25.051908 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 29 01:28:25.052167 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 29 01:28:25.052564 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.053566 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.053566 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.053566 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.053846 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.054152 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.054476 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.054804 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.055142 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.055404 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.055722 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.056074 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-813984-5-iscsi {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.056402 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.056713 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.057031 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.057355 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.057661 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.058132 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.058315 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.058811 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.060175 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.060175 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.060175 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.060547 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.060875 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.061191 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.061517 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.061830 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.062157 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.062470 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.062882 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-813984-5-iscsi {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.063200 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.063517 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.063861 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.064289 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.064603 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.064915 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.065240 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.065562 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.065872 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.066200 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.066523 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.066843 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.067164 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.068020 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.068413 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.068731 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.069059 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.069367 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.069674 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.069927 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.070235 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.070556 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.070894 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.071204 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.071455 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.071703 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.072045 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.072367 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.072677 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.072984 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.073291 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.073597 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.074029 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.074349 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.074929 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.075237 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.075562 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.075905 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.076230 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.083743 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.083743 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.083743 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.87 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.083743 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.87 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.083743 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.083743 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.083743 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.083743 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.085152 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.085152 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.085152 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.085152 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.085152 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.085152 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.085152 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.085152 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.085685 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.085685 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.085685 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.085685 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.085685 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.085685 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.085685 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.085685 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.086201 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.086201 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.086201 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.086201 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.086201 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.086201 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.086602 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.086602 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.086952 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.087211 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.087651 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.087865 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.089034 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.089034 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.089034 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.089305 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.089478 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.089794 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.090127 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.090432 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.090734 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.091207 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.091712 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.092049 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.092377 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.092687 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.093000 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.093324 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.093634 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.093944 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.094252 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.094560 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.094869 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.095247 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.095481 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.095806 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.096114 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.096436 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.096759 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.097070 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.097379 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.097684 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.098005 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.098350 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.098727 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.099084 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.099399 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.099849 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.100215 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.100521 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.100843 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.101173 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.101503 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.101821 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.102136 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.102452 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.102778 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.103100 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.103437 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.103839 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.104118 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.104422 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.104733 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.105054 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.105387 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.105715 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.106031 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.106571 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.106914 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.107234 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.107567 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.107905 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.108237 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.108555 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.108872 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.109190 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.109533 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.109849 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.110165 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.110507 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.110830 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.111141 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.111467 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.111892 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.112107 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.112608 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.112876 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.113201 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.113538 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.113846 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.114202 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.114568 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.114885 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.115212 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.115498 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.115840 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.116156 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.116469 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.116798 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.117114 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.117424 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.117785 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.118104 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.118412 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.118733 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.119050 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.119366 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.119685 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.120064 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.120412 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.124246 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.124246 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.124246 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.124246 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.124246 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.124246 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.124246 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.124246 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.125469 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.125469 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.125469 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.125469 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.125469 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.125469 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.125469 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.125469 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.127314 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.127314 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.127314 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.127314 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.127314 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.127314 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.128343 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.128343 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.128343 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.128796 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.128952 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.129175 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.129634 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.130461 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.130833 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.131152 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.131474 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.131909 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.132348 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.132511 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.132757 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.133085 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.133404 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.133740 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.134054 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.134382 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.134697 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.135055 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.135408 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.135782 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.136102 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.136435 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.136754 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.137075 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.137391 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.137708 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.138108 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.138108 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.138108 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.139227 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.139375 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.139570 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.139929 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.140247 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.140703 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.141152 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.141573 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.141773 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.142186 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.142589 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.142770 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.143040 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.143356 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.143671 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.144016 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.144326 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.144636 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.144949 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.145266 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.145648 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.146581 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.146842 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.147303 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.147621 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.147970 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.148282 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.148601 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.148940 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.149257 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.149587 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.149914 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.150224 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.150535 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.150866 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.151182 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.151493 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.151953 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.152472 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.152775 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.152957 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.153236 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.153528 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.154201 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.154201 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.155182 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.155182 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.155182 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.155642 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.155850 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.156004 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.156325 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.156641 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.156956 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.157272 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.157605 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.157925 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.158240 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.158555 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.158867 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.159181 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.159501 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.160349 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.160695 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.161022 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.161403 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.161724 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.162050 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.162480 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.162835 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.163026 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.163360 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.163795 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.164117 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.164432 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.164750 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.165066 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.165377 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.165687 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.167300 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.167300 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.167300 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.167300 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.167300 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.168155 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.168155 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.168155 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.168625 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.168903 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.169322 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.169642 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.169956 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.170269 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.170625 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.170938 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.171285 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.171620 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.172074 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.172307 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.172850 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.173040 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.173293 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.173627 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.173849 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.174166 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.174552 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.174782 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.175245 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.175592 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.175917 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.176235 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.176544 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.177389 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.177704 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.178027 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.178347 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.178659 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.179065 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.179278 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.179591 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.179926 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.180241 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.180547 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.180869 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.181179 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.181490 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.181798 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.182225 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.182424 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.182805 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.183085 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.183433 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.183882 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.184049 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.184310 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.184732 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.184912 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.185227 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.185558 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.185883 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.186193 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.186710 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.187020 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.187368 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.187639 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.190654 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.190654 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.190654 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.190654 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.190654 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.190654 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.190654 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.190654 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.192034 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.192034 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.192034 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.192034 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.192034 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.193849 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.193849 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.193849 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.193849 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.194622 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.194622 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.194622 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.195204 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.195204 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.195497 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.196034 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.196214 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.196390 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.196723 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.197042 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.197360 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.197861 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.198208 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.198547 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.198860 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.199176 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.199496 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.200110 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.200430 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.200818 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.201061 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.201379 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.201700 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.202019 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.202335 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.202646 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.202962 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.203467 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.203620 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.204084 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.204414 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.204702 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.205125 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.205331 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.205647 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.206062 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.206412 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.206733 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.207053 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.207367 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.207687 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.208132 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.208467 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.208936 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.209262 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.209697 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.210013 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.210333 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.210650 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.210979 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.211273 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.211590 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.211949 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.212263 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.212576 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.212889 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.213548 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.213548 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.213855 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.215000 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.215000 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.215000 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.215623 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.215623 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.215966 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.216269 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.216793 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.217130 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.217442 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.217768 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.218086 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.218424 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.218756 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.219075 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.219396 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.219707 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.220060 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.220390 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.220819 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.221154 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.221582 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.222434 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.222434 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.223347 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.223347 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.223347 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.224363 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.224363 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.224363 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.224865 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.224865 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.225299 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.225479 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.225785 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.226099 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.226411 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.226720 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.227046 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.227357 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.227685 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.228030 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.228358 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.228690 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.229005 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.229478 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.229802 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.230113 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.230425 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.230641 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 29 01:28:25.231407 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.231633 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 29 01:28:25.231932 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.232139 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 29 01:28:25.232353 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.232353 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.232780 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 29 01:28:25.232780 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 29 01:28:25.233209 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.233445 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.233710 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.234292 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.234653 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.234891 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.235120 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.235358 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.235763 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.236086 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.236319 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.236648 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.236885 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.237233 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.237459 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.237657 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.237809 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.237994 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.238166 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.238333 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.238482 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.238632 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.238779 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.238942 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-813984-5-iscsi {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.239099 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.239785 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.239953 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.240166 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.240377 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.240617 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.240783 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.240944 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.241104 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.241252 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.241516 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.241686 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.241843 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.241843 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.242138 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.242292 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.242449 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.242615 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.242772 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.242930 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.243078 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.243233 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.243233 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.243522 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.243677 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.243677 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.244034 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.244439 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.244620 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.244859 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.245019 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.245167 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.245336 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.245499 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.245683 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.245939 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.246186 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.246346 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.246494 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.246752 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.246752 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.247049 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-813984-5-iscsi {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.247216 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.247482 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.247647 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.247840 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.247993 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.248141 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.248287 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.248441 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.248603 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.248751 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.248922 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.249169 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.249330 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.249487 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.249636 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.249801 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.249957 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.250105 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.250105 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.251155 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.251309 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.251481 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.251481 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.251481 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.252052 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.252285 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.252285 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.252593 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.252751 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.252897 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.253150 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.253304 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.253451 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.253597 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.253743 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.253890 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.254044 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.254192 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.254614 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.254778 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.255857 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.256051 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.256416 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.256572 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.256757 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.257128 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.257283 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.257460 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.257738 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.257891 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.258041 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.258198 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.258198 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.258505 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.258663 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.258812 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.258812 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.259104 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.259260 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.259415 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.259563 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.259710 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.259909 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.260216 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.260393 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.260545 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.260693 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.260693 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.260693 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.260693 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.260693 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.260693 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.261527 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.261676 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.261955 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.262116 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.262275 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.262422 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.262569 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.262726 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.262875 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.263032 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.263227 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.263379 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.263379 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.263664 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.263847 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.264967 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.264967 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.265283 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.265439 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.87 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.265696 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.265851 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.87 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.266014 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.266171 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.266429 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.266698 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.266853 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.267029 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.267340 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.267493 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.267652 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.267993 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.268158 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.268321 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.268477 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.268632 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.268778 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.268924 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.269079 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.269237 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.269389 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.269542 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.269694 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.269694 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.270005 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.270173 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.270326 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.270326 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.270773 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.270957 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.271127 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.271289 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.271448 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.271609 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.271780 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.271972 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.271972 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.272399 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.272664 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.272845 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.273009 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.273173 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.273340 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.273495 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.273654 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.273807 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.273959 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.274111 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.274293 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.274447 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.274598 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.274986 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.275155 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.275319 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.275473 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.275641 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.275896 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.276066 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.276239 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.276395 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.276548 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.276738 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.276993 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.277151 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.277480 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.277642 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.277795 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.277967 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.278218 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.278386 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.278551 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.278712 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.278873 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.279035 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.279275 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.279447 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.279609 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.279813 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.279974 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.280141 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.280302 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.280455 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.280616 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.280770 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.280922 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.281088 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.281250 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.281414 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.281576 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.281736 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.281904 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.282057 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.282228 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.282465 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.282625 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.282777 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.282939 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.283093 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.283253 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.283407 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.283571 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.283750 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.283924 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.284085 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.284247 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.284400 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.284613 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.285158 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.285338 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.285493 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.285656 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.285817 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.286089 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.286261 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.286424 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.286578 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.286738 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.286899 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.287166 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.288048 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.288217 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.288379 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.288532 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.288692 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.288855 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.289057 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.289302 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 01:28:25.289302 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.289598 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.289759 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.289912 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.290081 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.290236 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.290397 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.290558 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.290719 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.290883 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.291038 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.291210 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.291378 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.291610 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.291789 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.291965 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.292121 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.292274 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.292454 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.292696 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.292856 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.293025 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.293181 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.293346 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.293498 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.293651 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.294087 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.294260 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.294423 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.294576 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.297210 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.301649 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.302347 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.302506 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.302700 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.302959 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.303130 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.303293 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.303456 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.303627 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.303824 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.303824 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.304216 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.304374 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.304527 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.304691 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.304892 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.304892 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.305204 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.305939 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.306270 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.306435 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.306590 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.306950 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.307120 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.307514 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.307674 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.307674 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.308030 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.308197 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.308352 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.308545 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.308858 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.309021 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.309176 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.309358 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.309583 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.309822 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.309984 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.310138 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.310301 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.310696 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.310870 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.311026 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.311260 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.311425 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.311588 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.311889 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.312074 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.312230 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.312383 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.312544 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.312710 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.312865 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.313128 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.313300 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.313454 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.313606 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.313773 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.313935 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.314100 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.314263 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.314425 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.314593 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.314748 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.314901 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.315053 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.315215 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.315369 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.315532 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.315687 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.315865 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.316025 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.316304 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.316476 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.316642 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.316796 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.316796 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.317414 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.318082 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.318248 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.318402 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.318554 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.318745 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.319151 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.319315 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.319501 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.319938 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.320125 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.320282 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.320519 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.320917 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.321246 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.321410 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.321565 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.321727 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.321873 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.321965 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.322065 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.322195 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.322321 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.322398 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.322483 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.322577 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.322664 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.322755 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.322848 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.322941 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.323028 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.323028 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.323211 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.323296 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.323388 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.323475 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.323560 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.323657 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.323920 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.324021 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.324116 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.324202 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.324302 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.324404 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.324491 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.324833 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.324926 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.325013 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.325106 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.325192 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.325283 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.325368 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.325452 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.325543 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.325637 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.325729 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.325821 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.325914 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.326010 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.326097 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.326190 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.327011 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.327151 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.327251 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.327348 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.327450 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.327537 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.327621 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.327713 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.327861 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.327957 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.328052 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.328139 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 29 01:28:25.328231 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.328231 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.328231 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.328231 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.328231 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.328231 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.328231 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.328231 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.328788 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.328788 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.328788 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.328788 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.328788 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.328788 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.328788 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.328788 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.329614 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.329614 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.329614 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.329614 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.329614 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.329614 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.329614 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.329614 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.330145 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.330145 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.330145 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.330145 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.330145 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.330145 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.330145 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.330145 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.330843 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.330843 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.330843 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.330843 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.330843 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.330843 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.330843 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.330843 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.331571 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.331571 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.331571 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.331571 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.331571 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.331571 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.331571 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.331571 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.332106 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.332106 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.332106 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.332106 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.332106 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.332106 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.332106 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.332106 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.332689 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.332689 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.332689 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.332689 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.332689 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.332689 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.332689 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.332689 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.333435 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.333435 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.333435 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.333435 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.333435 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.333435 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.333435 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.333435 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.334048 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.334048 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.334048 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.334254 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.334433 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.334720 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.335285 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_db.sqlalchemy.engines [None req-5277bdb4-7602-4985-9f2a-514f2bf1980c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116378) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 29 01:28:25.335664 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.336031 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.337655 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.337655 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.337655 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.337655 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.337655 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.338085 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.338228 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.338461 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.338770 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.339081 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.339393 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.339702 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.340043 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.340621 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.340954 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.341273 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.341590 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.341909 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.342229 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.342561 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.342905 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.343216 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.343523 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.343858 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.344183 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.344557 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.344799 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.345106 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.345410 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.345716 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.346033 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.346374 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.346706 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.347011 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.347318 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.348940 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.348940 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.348940 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.348940 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.349770 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.349770 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.349770 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.350052 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.350359 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.350711 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.351019 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.351362 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.351697 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.352178 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.352502 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.352923 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.353266 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.353577 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.353887 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.354195 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.354508 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.354818 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.355123 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.355438 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.355769 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.356140 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.356384 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.356689 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.357001 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.357303 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.357620 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.357928 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.358270 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.358576 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.358887 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.359193 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.359508 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.359834 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.360141 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.360459 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.360766 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.361070 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.361375 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.361683 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.361994 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.362296 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.362619 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.362929 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.363233 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.363535 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.363881 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.364696 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.365212 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.365536 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.365859 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.366181 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.366488 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.366800 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.367108 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.367412 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.367717 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.368046 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.368349 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.368653 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.368957 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.369338 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.369645 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.369970 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.370278 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.370582 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.370886 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.371188 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.371532 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.371861 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.372226 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.372531 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.372948 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.373278 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.373596 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.373912 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.374228 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.374535 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.374863 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.375201 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.375567 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.375854 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.376181 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.376509 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.376822 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.377166 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.377456 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.377780 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.378106 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.378412 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.378722 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.379034 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.379345 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.379655 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.380525 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.380922 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.381163 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.381475 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.381787 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.382097 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.382402 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.382712 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.383021 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.383326 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.383650 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.383985 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.384292 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.384602 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.384917 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.385219 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.385525 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.385959 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.386340 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.386661 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.386967 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.387281 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.387590 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.387930 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.388246 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.388555 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.388972 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.389282 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.389595 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.389912 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.390321 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.390627 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.390939 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.391262 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.391569 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.391899 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.392207 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.392570 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.392877 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.393200 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.393619 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.393932 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.394239 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.394655 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.394965 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.395282 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.395632 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.395975 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.396311 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.396614 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.396931 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.397244 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.397572 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.397898 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.398210 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.398525 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.398831 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.399155 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.399479 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.399849 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.400192 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.400658 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.400933 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.401250 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.401570 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.401897 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.402207 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.402574 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.402891 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.403199 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.403503 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.403851 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.404159 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.404471 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.404781 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.405090 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.405396 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.405702 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.406025 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.406336 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.406660 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.406974 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.407296 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.407618 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.407948 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.408273 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.408583 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.408889 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.409273 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.409586 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.409930 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.410242 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.410564 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.410899 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.411260 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.411568 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.411932 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.412786 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.412786 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.412985 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.413188 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.413491 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.413795 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.414105 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.414412 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.414717 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.415021 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.415116 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.context [None req-5277bdb4-7602-4985-9f2a-514f2bf1980c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),20da1628-5ce3-4c52-99e0-a722d80928b0(cell1) {{(pid=116378) load_cells /opt/stack/nova/nova/context.py:464}} Oct 29 01:28:25.415405 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.415713 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.416054 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.416354 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.416677 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.416983 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.417307 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.417616 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.417922 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.418225 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.418529 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.418873 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.419179 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.419487 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-5277bdb4-7602-4985-9f2a-514f2bf1980c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:28:25.419589 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.419846 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.420172 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.420498 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.420893 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.421093 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-5277bdb4-7602-4985-9f2a-514f2bf1980c None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:28:25.421194 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.421436 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.421749 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.421908 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-5277bdb4-7602-4985-9f2a-514f2bf1980c None None] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:28:25.422063 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.422380 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.422694 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.423007 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.423321 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.423630 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.423888 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-5277bdb4-7602-4985-9f2a-514f2bf1980c None None] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:28:25.424005 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.424268 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.424584 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.425144 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.425477 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.425796 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.426119 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.426433 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.427641 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.427998 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.428322 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.428642 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.428961 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.429278 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.429610 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.430033 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.430376 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.430725 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.431050 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.431371 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.431696 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.432067 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.432438 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.432760 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.433073 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.433395 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.433718 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.434038 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.435766 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.435766 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.435766 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.435766 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.436131 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_db.sqlalchemy.engines [None req-5277bdb4-7602-4985-9f2a-514f2bf1980c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116378) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 29 01:28:25.436234 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.436234 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.436376 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.436665 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.436875 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_db.sqlalchemy.engines [None req-5277bdb4-7602-4985-9f2a-514f2bf1980c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116378) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 29 01:28:25.437004 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.437339 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.437663 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.437985 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.438340 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.438864 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.439221 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.439542 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.439910 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.440244 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.440575 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.440919 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.441208 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.441538 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.441851 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.442157 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.443098 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.443416 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.443721 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.444268 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.444593 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.444907 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.445235 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.445550 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.446138 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.446451 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.446777 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.447113 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.447441 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.447785 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.448101 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.448431 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.448741 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.449051 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.449400 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.449971 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.450280 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.450592 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.450910 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.451223 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.451535 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.451869 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.452180 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.452507 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.452819 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.453125 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.453540 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.453857 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.454167 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.454476 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.454786 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.455096 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.455615 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.455765 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.456076 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.456386 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.456696 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.457007 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.457318 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.457624 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.458083 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.458505 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.458811 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.459133 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.459445 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.459802 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.460117 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.460439 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.460777 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.461097 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.461634 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.462015 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.462338 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.462686 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.463031 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.463346 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.463655 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.463990 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.464312 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.464625 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.464936 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.465247 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.465562 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.465867 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.466176 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.466488 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.466796 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.467113 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.467455 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.467790 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.468110 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.468428 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.468742 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.469053 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.469365 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.469675 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.469983 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.470300 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.470630 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.470945 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.471251 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.471774 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.472094 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.472417 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.472739 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.473049 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.473371 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.473729 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.474035 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.474354 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.474664 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.474993 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.475332 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.475665 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.476014 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.476318 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.476728 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.477044 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.477355 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.477689 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.478002 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.478325 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.478640 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.478959 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.479267 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.479589 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.479935 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.480252 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.480561 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.480895 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.481206 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.481519 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.481833 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.482145 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.482456 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.482766 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.483091 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.483981 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.483981 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.484277 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.484399 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.484718 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.485035 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.485349 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.485682 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.486050 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.486308 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.486620 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.486936 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.487251 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.487565 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.487917 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.488242 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.488566 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.488893 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.489811 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.490127 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.490474 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.490804 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 01:28:25.491055 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116379) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 29 01:28:25.514199 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_db.sqlalchemy.engines [None req-e61486e1-945d-47ea-be1b-9af2eb9acba4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116379) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 29 01:28:25.593308 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.context [None req-e61486e1-945d-47ea-be1b-9af2eb9acba4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),20da1628-5ce3-4c52-99e0-a722d80928b0(cell1) {{(pid=116379) load_cells /opt/stack/nova/nova/context.py:464}} Oct 29 01:28:25.597820 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-e61486e1-945d-47ea-be1b-9af2eb9acba4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:28:25.600058 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-e61486e1-945d-47ea-be1b-9af2eb9acba4 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:28:25.600865 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-e61486e1-945d-47ea-be1b-9af2eb9acba4 None None] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:28:25.602811 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-e61486e1-945d-47ea-be1b-9af2eb9acba4 None None] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:28:25.615023 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_db.sqlalchemy.engines [None req-e61486e1-945d-47ea-be1b-9af2eb9acba4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116379) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 29 01:28:25.616187 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_db.sqlalchemy.engines [None req-e61486e1-945d-47ea-be1b-9af2eb9acba4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116379) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 29 01:28:25.712390 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_db.sqlalchemy.engines [None req-5277bdb4-7602-4985-9f2a-514f2bf1980c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116378) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 29 01:28:25.878138 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_db.sqlalchemy.engines [None req-e61486e1-945d-47ea-be1b-9af2eb9acba4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116379) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 29 01:28:26.050398 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: WARNING keystonemiddleware.auth_token [None req-5277bdb4-7602-4985-9f2a-514f2bf1980c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 29 01:28:26.057986 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: WARNING keystonemiddleware.auth_token [None req-5277bdb4-7602-4985-9f2a-514f2bf1980c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 29 01:28:26.216248 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: WARNING keystonemiddleware.auth_token [None req-e61486e1-945d-47ea-be1b-9af2eb9acba4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 29 01:28:26.223494 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: WARNING keystonemiddleware.auth_token [None req-e61486e1-945d-47ea-be1b-9af2eb9acba4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 29 01:28:26.419292 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: WARNING keystonemiddleware.auth_token [None req-5277bdb4-7602-4985-9f2a-514f2bf1980c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 29 01:28:26.425203 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: WARNING keystonemiddleware.auth_token [None req-5277bdb4-7602-4985-9f2a-514f2bf1980c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 29 01:28:26.431427 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5640782e19c0 pid: 116378 (default app) Oct 29 01:28:26.578822 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: WARNING keystonemiddleware.auth_token [None req-e61486e1-945d-47ea-be1b-9af2eb9acba4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 29 01:28:26.584283 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: WARNING keystonemiddleware.auth_token [None req-e61486e1-945d-47ea-be1b-9af2eb9acba4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 29 01:28:26.589422 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5640782e19c0 pid: 116379 (default app) Oct 29 01:29:00.848057 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-c2da4210-dd51-4fb8-b0a4-5635a1c6db4b tempest-VolumesSnapshotsTestJSON-285716011 tempest-VolumesSnapshotsTestJSON-285716011-project] Action: 'create', calling method: .version_select at 0x7ff62d7f6f70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1330562308"}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:29:03.604756 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-c2da4210-dd51-4fb8-b0a4-5635a1c6db4b tempest-VolumesSnapshotsTestJSON-285716011 tempest-VolumesSnapshotsTestJSON-285716011-project] 10.222.0.87 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.963696 Oct 29 01:29:03.605772 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 1/1] 10.222.0.87 () {60 vars in 1154 bytes} [Fri Oct 29 01:28:59 2021] POST /compute/v2.1/os-volumes => generated 345 bytes in 3966 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 29 01:29:03.844615 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-37a1ad95-28ce-49e9-b6d9-4008a76b2a6e tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-148242109", "imageRef": "3b1d5dc6-2b04-4433-9a93-1db6a740092b", "flavorRef": "452", "networks": [{"uuid": "006f6d9c-421b-4727-965e-1d0818b23f42"}]}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:29:03.930581 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-79c7e84a-b913-43c1-9312-1e8d5ca19ad0 tempest-VolumesSnapshotsTestJSON-285716011 tempest-VolumesSnapshotsTestJSON-285716011-project] Calling method '.version_select at 0x7ff62d84cc10>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:04.079285 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.network.neutron [None req-37a1ad95-28ce-49e9-b6d9-4008a76b2a6e tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] validate_networks() for [('006f6d9c-421b-4727-965e-1d0818b23f42', None, None, None, None, None)] {{(pid=116378) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 29 01:29:04.561167 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-79c7e84a-b913-43c1-9312-1e8d5ca19ad0 tempest-VolumesSnapshotsTestJSON-285716011 tempest-VolumesSnapshotsTestJSON-285716011-project] 10.222.0.87 "GET /compute/v2.1/os-volumes/e0403cd5-c5c8-4b5c-9d5e-8688ee4e4bb5" status: 200 len: 346 microversion: 2.1 time: 0.945042 Oct 29 01:29:04.561809 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 1/2] 10.222.0.87 () {58 vars in 1244 bytes} [Fri Oct 29 01:29:03 2021] GET /compute/v2.1/os-volumes/e0403cd5-c5c8-4b5c-9d5e-8688ee4e4bb5 => generated 346 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:29:04.577748 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-cb435985-f615-49ac-b509-8a2938e615c3 tempest-VolumesSnapshotsTestJSON-285716011 tempest-VolumesSnapshotsTestJSON-285716011-project] Action: 'create', calling method: .version_select at 0x7ff62d869790>, body: {"snapshot": {"volume_id": "e0403cd5-c5c8-4b5c-9d5e-8688ee4e4bb5", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-554302681"}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:29:05.230979 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.virt.hardware [None req-37a1ad95-28ce-49e9-b6d9-4008a76b2a6e tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Flavor limits 0:0:0 {{(pid=116378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:29:05.231649 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.virt.hardware [None req-37a1ad95-28ce-49e9-b6d9-4008a76b2a6e tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Image limits 0:0:0 {{(pid=116378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:29:05.231854 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.virt.hardware [None req-37a1ad95-28ce-49e9-b6d9-4008a76b2a6e tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Flavor pref 0:0:0 {{(pid=116378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:29:05.232463 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.virt.hardware [None req-37a1ad95-28ce-49e9-b6d9-4008a76b2a6e tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Image pref 0:0:0 {{(pid=116378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:29:05.233031 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.virt.hardware [None req-37a1ad95-28ce-49e9-b6d9-4008a76b2a6e tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:29:05.248484 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-37a1ad95-28ce-49e9-b6d9-4008a76b2a6e tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:05.249199 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-37a1ad95-28ce-49e9-b6d9-4008a76b2a6e tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:05.250166 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-37a1ad95-28ce-49e9-b6d9-4008a76b2a6e tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:05.250758 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-37a1ad95-28ce-49e9-b6d9-4008a76b2a6e tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:05.333351 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.quota [None req-37a1ad95-28ce-49e9-b6d9-4008a76b2a6e tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Getting quotas for project bfb1a96bc2154de787f2d217b2ac27f7. Resources: {'instances', 'cores', 'ram'} {{(pid=116378) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 01:29:05.348740 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.quota [None req-37a1ad95-28ce-49e9-b6d9-4008a76b2a6e tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Getting quotas for user df16eb9ac1b7472ebe95d3739604e27b and project bfb1a96bc2154de787f2d217b2ac27f7. Resources: {'instances', 'cores', 'ram'} {{(pid=116378) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 01:29:05.364231 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-37a1ad95-28ce-49e9-b6d9-4008a76b2a6e tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Going to run 1 instances... {{(pid=116378) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 29 01:29:05.367670 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-37a1ad95-28ce-49e9-b6d9-4008a76b2a6e tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] [instance: 52d47b4c-e32e-4708-ade4-0be86b270c03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3b1d5dc6-2b04-4433-9a93-1db6a740092b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116378) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 29 01:29:05.506340 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-cb435985-f615-49ac-b509-8a2938e615c3 tempest-VolumesSnapshotsTestJSON-285716011 tempest-VolumesSnapshotsTestJSON-285716011-project] 10.222.0.87 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.868657 Oct 29 01:29:05.506340 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 2/3] 10.222.0.87 () {60 vars in 1161 bytes} [Fri Oct 29 01:29:04 2021] POST /compute/v2.1/os-snapshots => generated 286 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:29:05.506340 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-09e0214e-f6bd-4561-bc2c-cefc698e7fb8 tempest-VolumesTestJSON-1549008456 tempest-VolumesTestJSON-1549008456-project] Calling method '.version_select at 0x7ff62d6d2670>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:05.559508 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-09e0214e-f6bd-4561-bc2c-cefc698e7fb8 tempest-VolumesTestJSON-1549008456 tempest-VolumesTestJSON-1549008456-project] 10.222.0.87 "GET /compute/v2.1/os-volumes/e9966db4-1dae-47a3-95bd-e42f3c8a123e" status: 200 len: 350 microversion: 2.1 time: 0.111526 Oct 29 01:29:05.560903 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 3/4] 10.222.0.87 () {58 vars in 1244 bytes} [Fri Oct 29 01:29:05 2021] GET /compute/v2.1/os-volumes/e9966db4-1dae-47a3-95bd-e42f3c8a123e => generated 350 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:29:05.565143 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-d0bb616c-4de7-4734-be93-ff858c8b7e41 tempest-VolumesSnapshotsTestJSON-285716011 tempest-VolumesSnapshotsTestJSON-285716011-project] Calling method '.version_select at 0x7ff62e066310>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:05.627744 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-37a1ad95-28ce-49e9-b6d9-4008a76b2a6e tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.988504 Oct 29 01:29:05.634341 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 2/5] 10.222.0.87 () {60 vars in 1146 bytes} [Fri Oct 29 01:29:03 2021] POST /compute/v2.1/servers => generated 380 bytes in 1993 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:29:05.657691 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-64c0ea72-9d2a-429a-b562-c4d31149cf7a tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:05.658312 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-64c0ea72-9d2a-429a-b562-c4d31149cf7a tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] [instance: 52d47b4c-e32e-4708-ade4-0be86b270c03] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:05.666279 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-d0bb616c-4de7-4734-be93-ff858c8b7e41 tempest-VolumesSnapshotsTestJSON-285716011 tempest-VolumesSnapshotsTestJSON-285716011-project] 10.222.0.87 "GET /compute/v2.1/os-snapshots/6c0793c9-4319-42cd-971d-47cec7575119" status: 200 len: 286 microversion: 2.1 time: 0.104691 Oct 29 01:29:05.667003 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 4/6] 10.222.0.87 () {58 vars in 1250 bytes} [Fri Oct 29 01:29:05 2021] GET /compute/v2.1/os-snapshots/6c0793c9-4319-42cd-971d-47cec7575119 => generated 286 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:29:05.679187 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-87dc8287-f009-462b-9e4e-add41049f63b tempest-VolumesSnapshotsTestJSON-285716011 tempest-VolumesSnapshotsTestJSON-285716011-project] Calling method '.version_select at 0x7ff62d6d25e0>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:05.745689 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-87dc8287-f009-462b-9e4e-add41049f63b tempest-VolumesSnapshotsTestJSON-285716011 tempest-VolumesSnapshotsTestJSON-285716011-project] 10.222.0.87 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.068241 Oct 29 01:29:05.746756 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 5/7] 10.222.0.87 () {58 vars in 1139 bytes} [Fri Oct 29 01:29:05 2021] GET /compute/v2.1/os-snapshots => generated 289 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:29:05.757897 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-9b653913-9ba4-4870-b9ab-aedbc7adf23d tempest-VolumesSnapshotsTestJSON-285716011 tempest-VolumesSnapshotsTestJSON-285716011-project] Calling method '.version_select at 0x7ff62d6e1700>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:05.873161 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-9b653913-9ba4-4870-b9ab-aedbc7adf23d tempest-VolumesSnapshotsTestJSON-285716011 tempest-VolumesSnapshotsTestJSON-285716011-project] 10.222.0.87 "GET /compute/v2.1/os-snapshots/6c0793c9-4319-42cd-971d-47cec7575119" status: 200 len: 286 microversion: 2.1 time: 0.119930 Oct 29 01:29:05.875063 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 6/8] 10.222.0.87 () {58 vars in 1250 bytes} [Fri Oct 29 01:29:05 2021] GET /compute/v2.1/os-snapshots/6c0793c9-4319-42cd-971d-47cec7575119 => generated 286 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:29:05.882993 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-64c0ea72-9d2a-429a-b562-c4d31149cf7a tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df16eb9ac1b7472ebe95d3739604e27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1a96bc2154de787f2d217b2ac27f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:05.906286 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-64c0ea72-9d2a-429a-b562-c4d31149cf7a tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] 10.222.0.87 "GET /compute/v2.1/servers/52d47b4c-e32e-4708-ade4-0be86b270c03" status: 200 len: 1214 microversion: 2.1 time: 0.267328 Oct 29 01:29:05.907024 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 3/9] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:29:05 2021] GET /compute/v2.1/servers/52d47b4c-e32e-4708-ade4-0be86b270c03 => generated 1214 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:06.886474 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-8a10c8e6-13df-4c49-84b9-ab82f5cd7c58 tempest-VolumesSnapshotsTestJSON-285716011 tempest-VolumesSnapshotsTestJSON-285716011-project] Calling method '.version_select at 0x7ff62d6d2280>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:06.929960 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-74549d30-51ee-431e-830b-e419a58027e9 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:06.930576 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-74549d30-51ee-431e-830b-e419a58027e9 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] [instance: 52d47b4c-e32e-4708-ade4-0be86b270c03] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:06.998094 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-74549d30-51ee-431e-830b-e419a58027e9 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df16eb9ac1b7472ebe95d3739604e27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1a96bc2154de787f2d217b2ac27f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:07.005391 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-74549d30-51ee-431e-830b-e419a58027e9 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] 10.222.0.87 "GET /compute/v2.1/servers/52d47b4c-e32e-4708-ade4-0be86b270c03" status: 200 len: 1214 microversion: 2.1 time: 0.080702 Oct 29 01:29:07.005966 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 4/10] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:29:06 2021] GET /compute/v2.1/servers/52d47b4c-e32e-4708-ade4-0be86b270c03 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:29:07.113147 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-8a10c8e6-13df-4c49-84b9-ab82f5cd7c58 tempest-VolumesSnapshotsTestJSON-285716011 tempest-VolumesSnapshotsTestJSON-285716011-project] 10.222.0.87 "GET /compute/v2.1/os-snapshots/6c0793c9-4319-42cd-971d-47cec7575119" status: 200 len: 286 microversion: 2.1 time: 0.230499 Oct 29 01:29:07.113712 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 7/11] 10.222.0.87 () {58 vars in 1250 bytes} [Fri Oct 29 01:29:06 2021] GET /compute/v2.1/os-snapshots/6c0793c9-4319-42cd-971d-47cec7575119 => generated 286 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:29:08.023570 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-a99213bf-ad3d-4726-bbc8-9dc0efee4f9a tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:08.024221 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-a99213bf-ad3d-4726-bbc8-9dc0efee4f9a tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] [instance: 52d47b4c-e32e-4708-ade4-0be86b270c03] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:08.124391 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-08a2eb7f-0545-4b3a-bedc-288ce76f18ca tempest-VolumesSnapshotsTestJSON-285716011 tempest-VolumesSnapshotsTestJSON-285716011-project] Calling method '.version_select at 0x7ff62e066550>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:08.184148 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-08a2eb7f-0545-4b3a-bedc-288ce76f18ca tempest-VolumesSnapshotsTestJSON-285716011 tempest-VolumesSnapshotsTestJSON-285716011-project] 10.222.0.87 "GET /compute/v2.1/os-snapshots/6c0793c9-4319-42cd-971d-47cec7575119" status: 200 len: 286 microversion: 2.1 time: 0.063157 Oct 29 01:29:08.185384 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 8/12] 10.222.0.87 () {58 vars in 1250 bytes} [Fri Oct 29 01:29:08 2021] GET /compute/v2.1/os-snapshots/6c0793c9-4319-42cd-971d-47cec7575119 => generated 286 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:29:08.189133 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-a99213bf-ad3d-4726-bbc8-9dc0efee4f9a tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df16eb9ac1b7472ebe95d3739604e27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1a96bc2154de787f2d217b2ac27f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:08.200836 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-a99213bf-ad3d-4726-bbc8-9dc0efee4f9a tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] 10.222.0.87 "GET /compute/v2.1/servers/52d47b4c-e32e-4708-ade4-0be86b270c03" status: 200 len: 1214 microversion: 2.1 time: 0.179989 Oct 29 01:29:08.201816 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 5/13] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:29:08 2021] GET /compute/v2.1/servers/52d47b4c-e32e-4708-ade4-0be86b270c03 => generated 1214 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:09.197713 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-e77bf4a1-7d9c-4270-9bd8-3350b62ea1a3 tempest-VolumesSnapshotsTestJSON-285716011 tempest-VolumesSnapshotsTestJSON-285716011-project] Calling method '.version_select at 0x7ff62d6e15e0>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:09.244321 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-b7e25c5f-5caa-4439-9ee5-68d32fe3128c tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:09.249626 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-b7e25c5f-5caa-4439-9ee5-68d32fe3128c tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] [instance: 52d47b4c-e32e-4708-ade4-0be86b270c03] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:09.297541 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-b7e25c5f-5caa-4439-9ee5-68d32fe3128c tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:09.298066 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-b7e25c5f-5caa-4439-9ee5-68d32fe3128c tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:09.298470 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-b7e25c5f-5caa-4439-9ee5-68d32fe3128c tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:09.298900 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-b7e25c5f-5caa-4439-9ee5-68d32fe3128c tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:09.342139 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-e77bf4a1-7d9c-4270-9bd8-3350b62ea1a3 tempest-VolumesSnapshotsTestJSON-285716011 tempest-VolumesSnapshotsTestJSON-285716011-project] 10.222.0.87 "GET /compute/v2.1/os-snapshots/6c0793c9-4319-42cd-971d-47cec7575119" status: 200 len: 286 microversion: 2.1 time: 0.149927 Oct 29 01:29:09.342696 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 9/14] 10.222.0.87 () {58 vars in 1250 bytes} [Fri Oct 29 01:29:09 2021] GET /compute/v2.1/os-snapshots/6c0793c9-4319-42cd-971d-47cec7575119 => generated 286 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:29:09.683059 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-b7e25c5f-5caa-4439-9ee5-68d32fe3128c tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df16eb9ac1b7472ebe95d3739604e27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1a96bc2154de787f2d217b2ac27f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:09.695492 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-b7e25c5f-5caa-4439-9ee5-68d32fe3128c tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] 10.222.0.87 "GET /compute/v2.1/servers/52d47b4c-e32e-4708-ade4-0be86b270c03" status: 200 len: 1218 microversion: 2.1 time: 0.478530 Oct 29 01:29:09.704519 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 6/15] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:29:09 2021] GET /compute/v2.1/servers/52d47b4c-e32e-4708-ade4-0be86b270c03 => generated 1218 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:10.354809 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-cade55a0-d26b-4fea-aac2-53d7c5b29560 tempest-VolumesSnapshotsTestJSON-285716011 tempest-VolumesSnapshotsTestJSON-285716011-project] Calling method '.version_select at 0x7ff62d8695e0>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:10.394203 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-cade55a0-d26b-4fea-aac2-53d7c5b29560 tempest-VolumesSnapshotsTestJSON-285716011 tempest-VolumesSnapshotsTestJSON-285716011-project] 10.222.0.87 "GET /compute/v2.1/os-snapshots/6c0793c9-4319-42cd-971d-47cec7575119" status: 200 len: 287 microversion: 2.1 time: 0.044019 Oct 29 01:29:10.395345 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 10/16] 10.222.0.87 () {58 vars in 1250 bytes} [Fri Oct 29 01:29:10 2021] GET /compute/v2.1/os-snapshots/6c0793c9-4319-42cd-971d-47cec7575119 => generated 287 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:29:10.407009 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-86f96a1f-114a-4150-8bc1-bd5217088d67 tempest-VolumesSnapshotsTestJSON-285716011 tempest-VolumesSnapshotsTestJSON-285716011-project] Calling method '.version_select at 0x7ff62c526700>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:10.543465 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-04949fb7-9a80-41a7-8253-91d6890bc5a6 tempest-VolumesTestJSON-1549008456 tempest-VolumesTestJSON-1549008456-project] Calling method '.version_select at 0x7ff62d6d21f0>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:10.632193 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-86f96a1f-114a-4150-8bc1-bd5217088d67 tempest-VolumesSnapshotsTestJSON-285716011 tempest-VolumesSnapshotsTestJSON-285716011-project] 10.222.0.87 "DELETE /compute/v2.1/os-snapshots/6c0793c9-4319-42cd-971d-47cec7575119" status: 202 len: 0 microversion: 2.1 time: 0.228698 Oct 29 01:29:10.632193 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 7/17] 10.222.0.87 () {58 vars in 1253 bytes} [Fri Oct 29 01:29:10 2021] DELETE /compute/v2.1/os-snapshots/6c0793c9-4319-42cd-971d-47cec7575119 => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:29:10.639351 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-637b9738-fae0-4291-8179-22419ee9f924 tempest-VolumesSnapshotsTestJSON-285716011 tempest-VolumesSnapshotsTestJSON-285716011-project] Calling method '.version_select at 0x7ff62c4bc160>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:10.750598 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-04949fb7-9a80-41a7-8253-91d6890bc5a6 tempest-VolumesTestJSON-1549008456 tempest-VolumesTestJSON-1549008456-project] 10.222.0.87 "GET /compute/v2.1/os-volumes/466e31a0-d8b6-477a-bd4c-d13182b21037" status: 200 len: 351 microversion: 2.1 time: 0.215410 Oct 29 01:29:10.752136 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 11/18] 10.222.0.87 () {58 vars in 1244 bytes} [Fri Oct 29 01:29:10 2021] GET /compute/v2.1/os-volumes/466e31a0-d8b6-477a-bd4c-d13182b21037 => generated 351 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:29:10.758383 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-919f2454-21b4-4e56-aa33-b11668d046be tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:10.759179 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-919f2454-21b4-4e56-aa33-b11668d046be tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] [instance: 52d47b4c-e32e-4708-ade4-0be86b270c03] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:10.819343 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-919f2454-21b4-4e56-aa33-b11668d046be tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:10.819876 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-919f2454-21b4-4e56-aa33-b11668d046be tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:10.820621 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-919f2454-21b4-4e56-aa33-b11668d046be tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:10.822459 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-919f2454-21b4-4e56-aa33-b11668d046be tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:10.842270 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-637b9738-fae0-4291-8179-22419ee9f924 tempest-VolumesSnapshotsTestJSON-285716011 tempest-VolumesSnapshotsTestJSON-285716011-project] 10.222.0.87 "GET /compute/v2.1/os-snapshots/6c0793c9-4319-42cd-971d-47cec7575119" status: 200 len: 286 microversion: 2.1 time: 0.201205 Oct 29 01:29:10.842270 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 8/19] 10.222.0.87 () {58 vars in 1250 bytes} [Fri Oct 29 01:29:10 2021] GET /compute/v2.1/os-snapshots/6c0793c9-4319-42cd-971d-47cec7575119 => generated 286 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:29:11.226181 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-919f2454-21b4-4e56-aa33-b11668d046be tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df16eb9ac1b7472ebe95d3739604e27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1a96bc2154de787f2d217b2ac27f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:11.269311 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-919f2454-21b4-4e56-aa33-b11668d046be tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] 10.222.0.87 "GET /compute/v2.1/servers/52d47b4c-e32e-4708-ade4-0be86b270c03" status: 200 len: 1266 microversion: 2.1 time: 0.515046 Oct 29 01:29:11.274511 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 12/20] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:29:10 2021] GET /compute/v2.1/servers/52d47b4c-e32e-4708-ade4-0be86b270c03 => generated 1266 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:11.852899 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-a4e67f11-5374-48ae-8791-362aa80452e0 tempest-VolumesSnapshotsTestJSON-285716011 tempest-VolumesSnapshotsTestJSON-285716011-project] Calling method '.version_select at 0x7ff62c4c94c0>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:12.039318 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.wsgi [None req-a4e67f11-5374-48ae-8791-362aa80452e0 tempest-VolumesSnapshotsTestJSON-285716011 tempest-VolumesSnapshotsTestJSON-285716011-project] HTTP exception thrown: Snapshot 6c0793c9-4319-42cd-971d-47cec7575119 could not be found. Oct 29 01:29:12.040003 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-a4e67f11-5374-48ae-8791-362aa80452e0 tempest-VolumesSnapshotsTestJSON-285716011 tempest-VolumesSnapshotsTestJSON-285716011-project] Returning 404 to user: Snapshot 6c0793c9-4319-42cd-971d-47cec7575119 could not be found. {{(pid=116378) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:29:12.042034 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-a4e67f11-5374-48ae-8791-362aa80452e0 tempest-VolumesSnapshotsTestJSON-285716011 tempest-VolumesSnapshotsTestJSON-285716011-project] 10.222.0.87 "GET /compute/v2.1/os-snapshots/6c0793c9-4319-42cd-971d-47cec7575119" status: 404 len: 111 microversion: 2.1 time: 0.194782 Oct 29 01:29:12.042606 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 9/21] 10.222.0.87 () {58 vars in 1250 bytes} [Fri Oct 29 01:29:11 2021] GET /compute/v2.1/os-snapshots/6c0793c9-4319-42cd-971d-47cec7575119 => generated 111 bytes in 197 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:29:12.051941 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-b7bf30c4-62cf-48a6-86a2-d8b955086f35 tempest-VolumesSnapshotsTestJSON-285716011 tempest-VolumesSnapshotsTestJSON-285716011-project] Calling method '.version_select at 0x7ff62d5f5820>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:12.292946 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-20eb3b37-2426-4573-a8da-550f637ef984 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:12.294062 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-20eb3b37-2426-4573-a8da-550f637ef984 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] [instance: 52d47b4c-e32e-4708-ade4-0be86b270c03] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:12.306694 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-20eb3b37-2426-4573-a8da-550f637ef984 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:12.314975 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-20eb3b37-2426-4573-a8da-550f637ef984 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:12.318892 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-20eb3b37-2426-4573-a8da-550f637ef984 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:12.319527 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-20eb3b37-2426-4573-a8da-550f637ef984 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:12.488611 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-20eb3b37-2426-4573-a8da-550f637ef984 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df16eb9ac1b7472ebe95d3739604e27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1a96bc2154de787f2d217b2ac27f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:12.499572 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-20eb3b37-2426-4573-a8da-550f637ef984 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] 10.222.0.87 "GET /compute/v2.1/servers/52d47b4c-e32e-4708-ade4-0be86b270c03" status: 200 len: 1284 microversion: 2.1 time: 0.211464 Oct 29 01:29:12.521270 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 10/22] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:29:12 2021] GET /compute/v2.1/servers/52d47b4c-e32e-4708-ade4-0be86b270c03 => generated 1284 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:12.812244 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-b7bf30c4-62cf-48a6-86a2-d8b955086f35 tempest-VolumesSnapshotsTestJSON-285716011 tempest-VolumesSnapshotsTestJSON-285716011-project] 10.222.0.87 "DELETE /compute/v2.1/os-volumes/e0403cd5-c5c8-4b5c-9d5e-8688ee4e4bb5" status: 202 len: 0 microversion: 2.1 time: 0.761058 Oct 29 01:29:12.812244 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 13/23] 10.222.0.87 () {58 vars in 1247 bytes} [Fri Oct 29 01:29:12 2021] DELETE /compute/v2.1/os-volumes/e0403cd5-c5c8-4b5c-9d5e-8688ee4e4bb5 => generated 0 bytes in 763 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:29:12.817712 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-a692f1aa-3cc6-477f-bc65-606e5abda478 tempest-VolumesSnapshotsTestJSON-285716011 tempest-VolumesSnapshotsTestJSON-285716011-project] Calling method '.version_select at 0x7ff62e0644c0>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:13.108295 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-a692f1aa-3cc6-477f-bc65-606e5abda478 tempest-VolumesSnapshotsTestJSON-285716011 tempest-VolumesSnapshotsTestJSON-285716011-project] 10.222.0.87 "GET /compute/v2.1/os-volumes/e0403cd5-c5c8-4b5c-9d5e-8688ee4e4bb5" status: 200 len: 345 microversion: 2.1 time: 0.294716 Oct 29 01:29:13.109957 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 11/24] 10.222.0.87 () {58 vars in 1244 bytes} [Fri Oct 29 01:29:12 2021] GET /compute/v2.1/os-volumes/e0403cd5-c5c8-4b5c-9d5e-8688ee4e4bb5 => generated 345 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:29:13.235277 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-c24c99c4-808c-455c-be34-97cb6d5831b1 tempest-VolumesTestJSON-1549008456 tempest-VolumesTestJSON-1549008456-project] Calling method '.version_select at 0x7ff62d632a60>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:13.333213 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-c24c99c4-808c-455c-be34-97cb6d5831b1 tempest-VolumesTestJSON-1549008456 tempest-VolumesTestJSON-1549008456-project] 10.222.0.87 "GET /compute/v2.1/os-volumes/37e024d0-5639-47d4-8ff6-0ad91044fab6" status: 200 len: 350 microversion: 2.1 time: 0.101620 Oct 29 01:29:13.336040 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 14/25] 10.222.0.87 () {58 vars in 1244 bytes} [Fri Oct 29 01:29:13 2021] GET /compute/v2.1/os-volumes/37e024d0-5639-47d4-8ff6-0ad91044fab6 => generated 350 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:29:13.346812 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-a5196d39-0888-4fa4-b0e6-88776043e1db tempest-VolumesTestJSON-1549008456 tempest-VolumesTestJSON-1549008456-project] Calling method '.version_select at 0x7ff62c4eed30>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:13.538474 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-a5196d39-0888-4fa4-b0e6-88776043e1db tempest-VolumesTestJSON-1549008456 tempest-VolumesTestJSON-1549008456-project] 10.222.0.87 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.195958 Oct 29 01:29:13.541172 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 12/26] 10.222.0.87 () {58 vars in 1133 bytes} [Fri Oct 29 01:29:13 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:13.545880 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-30b6bd2a-ee64-473b-b10a-28e38b346a65 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:13.547024 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-30b6bd2a-ee64-473b-b10a-28e38b346a65 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] [instance: 52d47b4c-e32e-4708-ade4-0be86b270c03] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:13.560380 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-30b6bd2a-ee64-473b-b10a-28e38b346a65 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:13.563027 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-30b6bd2a-ee64-473b-b10a-28e38b346a65 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:13.567539 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-30b6bd2a-ee64-473b-b10a-28e38b346a65 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:13.568240 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-30b6bd2a-ee64-473b-b10a-28e38b346a65 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:13.583624 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-dad83cde-272c-438f-abf2-a25d43e8ce77 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Action: 'create', calling method: .version_select at 0x7ff62d632dc0>, body: {"keypair": {"name": "tempest-keypair-668136227"}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:29:13.777360 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.quota [None req-dad83cde-272c-438f-abf2-a25d43e8ce77 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Getting quotas for project 413ce1a7d8504d0b9f656d9e623f9005. Resources: {'key_pairs'} {{(pid=116379) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 01:29:13.793797 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.quota [None req-dad83cde-272c-438f-abf2-a25d43e8ce77 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Getting quotas for user 78823bdcff4e45d8ab82558b434f188d and project 413ce1a7d8504d0b9f656d9e623f9005. Resources: {'key_pairs'} {{(pid=116379) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 01:29:13.875417 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-30b6bd2a-ee64-473b-b10a-28e38b346a65 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df16eb9ac1b7472ebe95d3739604e27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1a96bc2154de787f2d217b2ac27f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:13.896785 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-30b6bd2a-ee64-473b-b10a-28e38b346a65 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] 10.222.0.87 "GET /compute/v2.1/servers/52d47b4c-e32e-4708-ade4-0be86b270c03" status: 200 len: 1272 microversion: 2.1 time: 0.354236 Oct 29 01:29:13.912107 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 13/27] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:29:13 2021] GET /compute/v2.1/servers/52d47b4c-e32e-4708-ade4-0be86b270c03 => generated 1272 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:13.919801 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-130a6829-33ee-4499-8711-091e2b6eeaff tempest-VolumesTestJSON-1549008456 tempest-VolumesTestJSON-1549008456-project] Calling method '.version_select at 0x7ff62c4c9af0>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:14.117463 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-130a6829-33ee-4499-8711-091e2b6eeaff tempest-VolumesTestJSON-1549008456 tempest-VolumesTestJSON-1549008456-project] 10.222.0.87 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.203891 Oct 29 01:29:14.118119 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 14/28] 10.222.0.87 () {58 vars in 1148 bytes} [Fri Oct 29 01:29:13 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:29:14.265442 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-d023e549-f875-4cbd-9adb-48ef22fb8650 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Action: 'create', calling method: .version_select at 0x7ff62c480e50>, body: {"keypair": {"name": "tempest-keypair-1364222965"}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:29:14.328413 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.quota [None req-d023e549-f875-4cbd-9adb-48ef22fb8650 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Getting quotas for project c51a2093a0874d52a08f6e25489ba181. Resources: {'key_pairs'} {{(pid=116378) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 01:29:14.340771 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.quota [None req-d023e549-f875-4cbd-9adb-48ef22fb8650 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Getting quotas for user 045dda1ff9b44334954c08e63fcd20c0 and project c51a2093a0874d52a08f6e25489ba181. Resources: {'key_pairs'} {{(pid=116378) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 01:29:14.451537 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.quota [None req-dad83cde-272c-438f-abf2-a25d43e8ce77 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Getting quotas for project 413ce1a7d8504d0b9f656d9e623f9005. Resources: {'key_pairs'} {{(pid=116379) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 01:29:14.459453 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.quota [None req-dad83cde-272c-438f-abf2-a25d43e8ce77 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Getting quotas for user 78823bdcff4e45d8ab82558b434f188d and project 413ce1a7d8504d0b9f656d9e623f9005. Resources: {'key_pairs'} {{(pid=116379) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 01:29:14.492913 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-dad83cde-272c-438f-abf2-a25d43e8ce77 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 1.024417 Oct 29 01:29:14.503572 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 15/29] 10.222.0.87 () {62 vars in 1198 bytes} [Fri Oct 29 01:29:13 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 1028 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Oct 29 01:29:14.517874 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-97dd8bf1-1123-447a-8e29-363d8ff41d01 tempest-VolumesSnapshotsTestJSON-285716011 tempest-VolumesSnapshotsTestJSON-285716011-project] Calling method '.version_select at 0x7ff62d5b0c10>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:14.624229 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-97dd8bf1-1123-447a-8e29-363d8ff41d01 tempest-VolumesSnapshotsTestJSON-285716011 tempest-VolumesSnapshotsTestJSON-285716011-project] 10.222.0.87 "GET /compute/v2.1/os-volumes/e0403cd5-c5c8-4b5c-9d5e-8688ee4e4bb5" status: 200 len: 345 microversion: 2.1 time: 0.127277 Oct 29 01:29:14.625530 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 16/30] 10.222.0.87 () {58 vars in 1244 bytes} [Fri Oct 29 01:29:14 2021] GET /compute/v2.1/os-volumes/e0403cd5-c5c8-4b5c-9d5e-8688ee4e4bb5 => generated 345 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:29:14.648165 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-e028d9c1-8b23-491b-8c66-877c109b9981 tempest-VolumesTestJSON-1549008456 tempest-VolumesTestJSON-1549008456-project] Calling method '.version_select at 0x7ff62ccfc550>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:14.679107 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.quota [None req-d023e549-f875-4cbd-9adb-48ef22fb8650 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Getting quotas for project c51a2093a0874d52a08f6e25489ba181. Resources: {'key_pairs'} {{(pid=116378) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 01:29:14.700730 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.quota [None req-d023e549-f875-4cbd-9adb-48ef22fb8650 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Getting quotas for user 045dda1ff9b44334954c08e63fcd20c0 and project c51a2093a0874d52a08f6e25489ba181. Resources: {'key_pairs'} {{(pid=116378) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 01:29:14.736009 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-d023e549-f875-4cbd-9adb-48ef22fb8650 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.611873 Oct 29 01:29:14.736009 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 15/31] 10.222.0.87 () {60 vars in 1157 bytes} [Fri Oct 29 01:29:14 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:14.808900 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-e028d9c1-8b23-491b-8c66-877c109b9981 tempest-VolumesTestJSON-1549008456 tempest-VolumesTestJSON-1549008456-project] 10.222.0.87 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.178323 Oct 29 01:29:14.808900 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 17/32] 10.222.0.87 () {58 vars in 1133 bytes} [Fri Oct 29 01:29:14 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:14.821482 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-045bf571-3a2f-46cb-af52-42eacf3f9fca tempest-VolumesTestJSON-1549008456 tempest-VolumesTestJSON-1549008456-project] Calling method '.version_select at 0x7ff62c4bc040>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:15.001306 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-045bf571-3a2f-46cb-af52-42eacf3f9fca tempest-VolumesTestJSON-1549008456 tempest-VolumesTestJSON-1549008456-project] 10.222.0.87 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.186407 Oct 29 01:29:15.003083 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 16/33] 10.222.0.87 () {58 vars in 1166 bytes} [Fri Oct 29 01:29:14 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:29:15.003406 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-ef5a2a77-34db-46a8-a3eb-17aa46d8cd8f tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-765097676", "imageRef": "3b1d5dc6-2b04-4433-9a93-1db6a740092b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "994299c4-5e9a-49d2-8046-83a41a29fd88"}]}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:29:15.014522 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-a3710c23-c636-4b60-89c6-72e3e68e1786 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:15.015381 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-a3710c23-c636-4b60-89c6-72e3e68e1786 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] [instance: 52d47b4c-e32e-4708-ade4-0be86b270c03] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:15.029028 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a3710c23-c636-4b60-89c6-72e3e68e1786 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:15.029705 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a3710c23-c636-4b60-89c6-72e3e68e1786 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:15.032856 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a3710c23-c636-4b60-89c6-72e3e68e1786 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:15.033598 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a3710c23-c636-4b60-89c6-72e3e68e1786 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:15.105442 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.network.neutron [None req-ef5a2a77-34db-46a8-a3eb-17aa46d8cd8f tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] validate_networks() for [('994299c4-5e9a-49d2-8046-83a41a29fd88', None, None, None, None, None)] {{(pid=116379) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 29 01:29:15.662191 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-a3710c23-c636-4b60-89c6-72e3e68e1786 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df16eb9ac1b7472ebe95d3739604e27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1a96bc2154de787f2d217b2ac27f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:15.662191 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-a3710c23-c636-4b60-89c6-72e3e68e1786 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] 10.222.0.87 "GET /compute/v2.1/servers/52d47b4c-e32e-4708-ade4-0be86b270c03" status: 200 len: 1314 microversion: 2.1 time: 0.574514 Oct 29 01:29:15.662191 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 17/34] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:29:15 2021] GET /compute/v2.1/servers/52d47b4c-e32e-4708-ade4-0be86b270c03 => generated 1314 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:15.662191 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-af7e76f5-7b9b-4412-a0b9-ea6583420c7f tempest-VolumesTestJSON-1549008456 tempest-VolumesTestJSON-1549008456-project] Calling method '.version_select at 0x7ff62c4bc1f0>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:15.754383 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-af7e76f5-7b9b-4412-a0b9-ea6583420c7f tempest-VolumesTestJSON-1549008456 tempest-VolumesTestJSON-1549008456-project] 10.222.0.87 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.171229 Oct 29 01:29:15.754752 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 18/35] 10.222.0.87 () {58 vars in 1169 bytes} [Fri Oct 29 01:29:15 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:29:15.765809 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-a155ea6e-c141-40f2-a9f9-5f33a3950e2a tempest-VolumesSnapshotsTestJSON-285716011 tempest-VolumesSnapshotsTestJSON-285716011-project] Calling method '.version_select at 0x7ff62c4a9f70>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:15.837078 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-a155ea6e-c141-40f2-a9f9-5f33a3950e2a tempest-VolumesSnapshotsTestJSON-285716011 tempest-VolumesSnapshotsTestJSON-285716011-project] 10.222.0.87 "GET /compute/v2.1/os-volumes/e0403cd5-c5c8-4b5c-9d5e-8688ee4e4bb5" status: 200 len: 345 microversion: 2.1 time: 0.081100 Oct 29 01:29:15.837905 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 19/36] 10.222.0.87 () {58 vars in 1244 bytes} [Fri Oct 29 01:29:15 2021] GET /compute/v2.1/os-volumes/e0403cd5-c5c8-4b5c-9d5e-8688ee4e4bb5 => generated 345 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:29:15.842852 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-3f065359-2e37-4e9a-b213-81d4beec77c4 tempest-VolumesTestJSON-1549008456 tempest-VolumesTestJSON-1549008456-project] Calling method '.version_select at 0x7ff62c4a9280>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:15.984796 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-3f065359-2e37-4e9a-b213-81d4beec77c4 tempest-VolumesTestJSON-1549008456 tempest-VolumesTestJSON-1549008456-project] 10.222.0.87 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.145838 Oct 29 01:29:15.986569 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 20/37] 10.222.0.87 () {58 vars in 1154 bytes} [Fri Oct 29 01:29:15 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:15.998965 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-20155be0-8e22-44dc-8dfc-ae3137e8a9fe tempest-VolumesTestJSON-1549008456 tempest-VolumesTestJSON-1549008456-project] Calling method '.version_select at 0x7ff62c4a95e0>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:16.093480 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-20155be0-8e22-44dc-8dfc-ae3137e8a9fe tempest-VolumesTestJSON-1549008456 tempest-VolumesTestJSON-1549008456-project] 10.222.0.87 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.099124 Oct 29 01:29:16.095942 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 21/38] 10.222.0.87 () {58 vars in 1187 bytes} [Fri Oct 29 01:29:15 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:29:16.108991 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-17497ff8-de41-4ad7-9c07-0b28f717257a tempest-VolumesTestJSON-1549008456 tempest-VolumesTestJSON-1549008456-project] Calling method '.version_select at 0x7ff62e064430>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:16.209733 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-17497ff8-de41-4ad7-9c07-0b28f717257a tempest-VolumesTestJSON-1549008456 tempest-VolumesTestJSON-1549008456-project] 10.222.0.87 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.105298 Oct 29 01:29:16.211424 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 22/39] 10.222.0.87 () {58 vars in 1154 bytes} [Fri Oct 29 01:29:16 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:16.466193 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.virt.hardware [None req-ef5a2a77-34db-46a8-a3eb-17aa46d8cd8f tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Flavor limits 0:0:0 {{(pid=116379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:29:16.470494 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.virt.hardware [None req-ef5a2a77-34db-46a8-a3eb-17aa46d8cd8f tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Image limits 0:0:0 {{(pid=116379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:29:16.471175 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.virt.hardware [None req-ef5a2a77-34db-46a8-a3eb-17aa46d8cd8f tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Flavor pref 0:0:0 {{(pid=116379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:29:16.473064 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.virt.hardware [None req-ef5a2a77-34db-46a8-a3eb-17aa46d8cd8f tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Image pref 0:0:0 {{(pid=116379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:29:16.474618 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.virt.hardware [None req-ef5a2a77-34db-46a8-a3eb-17aa46d8cd8f tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:29:16.517109 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-ef5a2a77-34db-46a8-a3eb-17aa46d8cd8f tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:16.517783 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-ef5a2a77-34db-46a8-a3eb-17aa46d8cd8f tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:16.518744 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-ef5a2a77-34db-46a8-a3eb-17aa46d8cd8f tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:16.519183 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-ef5a2a77-34db-46a8-a3eb-17aa46d8cd8f tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:16.587894 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.quota [None req-ef5a2a77-34db-46a8-a3eb-17aa46d8cd8f tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Getting quotas for project 4b037cd872fe4e0b8b9429048c567b1b. Resources: {'instances', 'cores', 'ram'} {{(pid=116379) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 01:29:16.593470 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.quota [None req-ef5a2a77-34db-46a8-a3eb-17aa46d8cd8f tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Getting quotas for user ac27192a9b2148f4bff8814f63813098 and project 4b037cd872fe4e0b8b9429048c567b1b. Resources: {'instances', 'cores', 'ram'} {{(pid=116379) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 01:29:16.597939 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-4c1e983d-2db8-46f3-85a0-3ac3d6a1899d tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:16.598970 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-4c1e983d-2db8-46f3-85a0-3ac3d6a1899d tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] [instance: 52d47b4c-e32e-4708-ade4-0be86b270c03] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:16.613743 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4c1e983d-2db8-46f3-85a0-3ac3d6a1899d tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:16.615965 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4c1e983d-2db8-46f3-85a0-3ac3d6a1899d tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:16.618187 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-ef5a2a77-34db-46a8-a3eb-17aa46d8cd8f tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Going to run 1 instances... {{(pid=116379) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 29 01:29:16.618624 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4c1e983d-2db8-46f3-85a0-3ac3d6a1899d tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:16.619161 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4c1e983d-2db8-46f3-85a0-3ac3d6a1899d tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:16.631499 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-ef5a2a77-34db-46a8-a3eb-17aa46d8cd8f tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3b1d5dc6-2b04-4433-9a93-1db6a740092b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116379) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 29 01:29:16.916649 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-ef5a2a77-34db-46a8-a3eb-17aa46d8cd8f tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.029640 Oct 29 01:29:16.916649 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 18/40] 10.222.0.87 () {60 vars in 1146 bytes} [Fri Oct 29 01:29:14 2021] POST /compute/v2.1/servers => generated 383 bytes in 2031 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:29:16.916649 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-6f998d3e-2fa5-4e27-9afd-b79d3cf3f889 tempest-VolumesSnapshotsTestJSON-285716011 tempest-VolumesSnapshotsTestJSON-285716011-project] Calling method '.version_select at 0x7ff62cce0790>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:17.044221 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-6f998d3e-2fa5-4e27-9afd-b79d3cf3f889 tempest-VolumesSnapshotsTestJSON-285716011 tempest-VolumesSnapshotsTestJSON-285716011-project] 10.222.0.87 "GET /compute/v2.1/os-volumes/e0403cd5-c5c8-4b5c-9d5e-8688ee4e4bb5" status: 200 len: 345 microversion: 2.1 time: 0.135547 Oct 29 01:29:17.045650 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 19/41] 10.222.0.87 () {58 vars in 1244 bytes} [Fri Oct 29 01:29:16 2021] GET /compute/v2.1/os-volumes/e0403cd5-c5c8-4b5c-9d5e-8688ee4e4bb5 => generated 345 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:29:17.051490 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-6431d04e-be31-42d9-96e8-e68123f4b396 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:17.054195 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-6431d04e-be31-42d9-96e8-e68123f4b396 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:17.356617 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-6431d04e-be31-42d9-96e8-e68123f4b396 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:17.381667 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-6431d04e-be31-42d9-96e8-e68123f4b396 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca" status: 200 len: 1221 microversion: 2.1 time: 0.334629 Oct 29 01:29:17.384757 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 20/42] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:29:17 2021] GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca => generated 1221 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:17.510692 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-4c1e983d-2db8-46f3-85a0-3ac3d6a1899d tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df16eb9ac1b7472ebe95d3739604e27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1a96bc2154de787f2d217b2ac27f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:17.536045 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-4c1e983d-2db8-46f3-85a0-3ac3d6a1899d tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] 10.222.0.87 "GET /compute/v2.1/servers/52d47b4c-e32e-4708-ade4-0be86b270c03" status: 200 len: 1314 microversion: 2.1 time: 0.939575 Oct 29 01:29:17.542738 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 23/43] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:29:16 2021] GET /compute/v2.1/servers/52d47b4c-e32e-4708-ade4-0be86b270c03 => generated 1314 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:29:17.600544 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-9c24f70b-ef11-4e37-a46c-7fe77ac55f36 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1712409192", "imageRef": "3b1d5dc6-2b04-4433-9a93-1db6a740092b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "994299c4-5e9a-49d2-8046-83a41a29fd88"}]}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:29:17.721344 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.network.neutron [None req-9c24f70b-ef11-4e37-a46c-7fe77ac55f36 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] validate_networks() for [('994299c4-5e9a-49d2-8046-83a41a29fd88', None, None, None, None, None)] {{(pid=116379) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 29 01:29:18.059326 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-89525927-5b14-4efd-9569-69a6d23ecefc tempest-VolumesSnapshotsTestJSON-285716011 tempest-VolumesSnapshotsTestJSON-285716011-project] Calling method '.version_select at 0x7ff62c4a9820>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:18.295300 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-89525927-5b14-4efd-9569-69a6d23ecefc tempest-VolumesSnapshotsTestJSON-285716011 tempest-VolumesSnapshotsTestJSON-285716011-project] 10.222.0.87 "GET /compute/v2.1/os-volumes/e0403cd5-c5c8-4b5c-9d5e-8688ee4e4bb5" status: 200 len: 345 microversion: 2.1 time: 0.240621 Oct 29 01:29:18.302680 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 24/44] 10.222.0.87 () {58 vars in 1244 bytes} [Fri Oct 29 01:29:18 2021] GET /compute/v2.1/os-volumes/e0403cd5-c5c8-4b5c-9d5e-8688ee4e4bb5 => generated 345 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:29:18.556032 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-b77d9035-cfff-4fd5-9db1-2d594005fb33 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:18.556802 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-b77d9035-cfff-4fd5-9db1-2d594005fb33 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] [instance: 52d47b4c-e32e-4708-ade4-0be86b270c03] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:18.569481 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-b77d9035-cfff-4fd5-9db1-2d594005fb33 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:18.579304 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-b77d9035-cfff-4fd5-9db1-2d594005fb33 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:18.583367 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-b77d9035-cfff-4fd5-9db1-2d594005fb33 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:18.587864 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-b77d9035-cfff-4fd5-9db1-2d594005fb33 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:19.355697 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-b77d9035-cfff-4fd5-9db1-2d594005fb33 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df16eb9ac1b7472ebe95d3739604e27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1a96bc2154de787f2d217b2ac27f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:19.372072 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-b77d9035-cfff-4fd5-9db1-2d594005fb33 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] 10.222.0.87 "GET /compute/v2.1/servers/52d47b4c-e32e-4708-ade4-0be86b270c03" status: 200 len: 1314 microversion: 2.1 time: 0.819800 Oct 29 01:29:19.373569 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 25/45] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:29:18 2021] GET /compute/v2.1/servers/52d47b4c-e32e-4708-ade4-0be86b270c03 => generated 1314 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:19.382723 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-09e55031-e23f-413b-89a2-1195be4925d5 tempest-VolumesSnapshotsTestJSON-285716011 tempest-VolumesSnapshotsTestJSON-285716011-project] Calling method '.version_select at 0x7ff62e064550>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:19.561913 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-09e55031-e23f-413b-89a2-1195be4925d5 tempest-VolumesSnapshotsTestJSON-285716011 tempest-VolumesSnapshotsTestJSON-285716011-project] 10.222.0.87 "GET /compute/v2.1/os-volumes/e0403cd5-c5c8-4b5c-9d5e-8688ee4e4bb5" status: 200 len: 345 microversion: 2.1 time: 0.185349 Oct 29 01:29:19.564473 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 26/46] 10.222.0.87 () {58 vars in 1244 bytes} [Fri Oct 29 01:29:19 2021] GET /compute/v2.1/os-volumes/e0403cd5-c5c8-4b5c-9d5e-8688ee4e4bb5 => generated 345 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:29:19.899129 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.virt.hardware [None req-9c24f70b-ef11-4e37-a46c-7fe77ac55f36 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Flavor limits 0:0:0 {{(pid=116379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:29:19.902909 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.virt.hardware [None req-9c24f70b-ef11-4e37-a46c-7fe77ac55f36 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Image limits 0:0:0 {{(pid=116379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:29:19.903760 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.virt.hardware [None req-9c24f70b-ef11-4e37-a46c-7fe77ac55f36 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Flavor pref 0:0:0 {{(pid=116379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:29:19.910669 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.virt.hardware [None req-9c24f70b-ef11-4e37-a46c-7fe77ac55f36 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Image pref 0:0:0 {{(pid=116379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:29:19.910669 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.virt.hardware [None req-9c24f70b-ef11-4e37-a46c-7fe77ac55f36 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:29:19.933366 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-9c24f70b-ef11-4e37-a46c-7fe77ac55f36 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:19.934257 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-9c24f70b-ef11-4e37-a46c-7fe77ac55f36 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:19.935267 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-9c24f70b-ef11-4e37-a46c-7fe77ac55f36 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:19.936073 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-9c24f70b-ef11-4e37-a46c-7fe77ac55f36 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:19.981207 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.quota [None req-9c24f70b-ef11-4e37-a46c-7fe77ac55f36 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Getting quotas for project 4b037cd872fe4e0b8b9429048c567b1b. Resources: {'instances', 'cores', 'ram'} {{(pid=116379) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 01:29:19.983142 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.quota [None req-9c24f70b-ef11-4e37-a46c-7fe77ac55f36 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Getting quotas for user ac27192a9b2148f4bff8814f63813098 and project 4b037cd872fe4e0b8b9429048c567b1b. Resources: {'instances', 'cores', 'ram'} {{(pid=116379) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 01:29:20.056582 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-9c24f70b-ef11-4e37-a46c-7fe77ac55f36 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Going to run 1 instances... {{(pid=116379) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 29 01:29:20.056582 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-9c24f70b-ef11-4e37-a46c-7fe77ac55f36 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 8daa36f8-7d64-4d9d-94e6-0519848d4a2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3b1d5dc6-2b04-4433-9a93-1db6a740092b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116379) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 29 01:29:20.119795 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [req-9cc6a184-baad-464b-83c6-66d43fcc8d11 req-d2f4f196-426f-46af-9d6e-94213a3f6461 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52d47b4c-e32e-4708-ade4-0be86b270c03", "tag": "7c7389c9-c004-43ca-b348-25bb91613962"}]} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:29:20.124501 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:29:20.124501 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: warnings.warn(msg) Oct 29 01:29:20.146395 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [req-9cc6a184-baad-464b-83c6-66d43fcc8d11 req-d2f4f196-426f-46af-9d6e-94213a3f6461 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:20.147241 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [req-9cc6a184-baad-464b-83c6-66d43fcc8d11 req-d2f4f196-426f-46af-9d6e-94213a3f6461 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:20.223327 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.compute.server_external_events [req-9cc6a184-baad-464b-83c6-66d43fcc8d11 req-d2f4f196-426f-46af-9d6e-94213a3f6461 service nova] Creating event network-changed:7c7389c9-c004-43ca-b348-25bb91613962 for instance 52d47b4c-e32e-4708-ade4-0be86b270c03 on hv-cinder-81398 Oct 29 01:29:20.225257 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [req-9cc6a184-baad-464b-83c6-66d43fcc8d11 req-d2f4f196-426f-46af-9d6e-94213a3f6461 service nova] Acquired lock "compute-rpcapi-router" {{(pid=116378) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Oct 29 01:29:20.242571 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-767b8ab5-1e76-4955-ba9e-1a2d978ff3b9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:20.243151 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-767b8ab5-1e76-4955-ba9e-1a2d978ff3b9 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:20.244083 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-767b8ab5-1e76-4955-ba9e-1a2d978ff3b9 None None] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:20.244519 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-767b8ab5-1e76-4955-ba9e-1a2d978ff3b9 None None] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:20.255805 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.compute.rpcapi [None req-767b8ab5-1e76-4955-ba9e-1a2d978ff3b9 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Oct 29 01:29:20.257232 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-767b8ab5-1e76-4955-ba9e-1a2d978ff3b9 None None] Releasing lock "compute-rpcapi-router" {{(pid=116378) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Oct 29 01:29:20.340953 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-767b8ab5-1e76-4955-ba9e-1a2d978ff3b9 None None] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.356792 Oct 29 01:29:20.341731 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 27/47] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Oct 29 01:29:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:29:20.342628 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-9c24f70b-ef11-4e37-a46c-7fe77ac55f36 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.741321 Oct 29 01:29:20.345488 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 21/48] 10.222.0.87 () {60 vars in 1146 bytes} [Fri Oct 29 01:29:17 2021] POST /compute/v2.1/servers => generated 383 bytes in 2750 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:29:20.355673 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-6b705715-9e13-4a40-a0f3-e7913b2a2513 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:20.356806 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-6b705715-9e13-4a40-a0f3-e7913b2a2513 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 8daa36f8-7d64-4d9d-94e6-0519848d4a2c] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:20.389675 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-90f58e45-ced7-4ce4-9074-4e6aa9d8c0ac tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:20.390287 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-90f58e45-ced7-4ce4-9074-4e6aa9d8c0ac tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] [instance: 52d47b4c-e32e-4708-ade4-0be86b270c03] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:20.433979 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-90f58e45-ced7-4ce4-9074-4e6aa9d8c0ac tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:20.433979 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-90f58e45-ced7-4ce4-9074-4e6aa9d8c0ac tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:20.433979 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-90f58e45-ced7-4ce4-9074-4e6aa9d8c0ac tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:20.433979 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-90f58e45-ced7-4ce4-9074-4e6aa9d8c0ac tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:20.733116 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-6b705715-9e13-4a40-a0f3-e7913b2a2513 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:20.740319 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-6b705715-9e13-4a40-a0f3-e7913b2a2513 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c" status: 200 len: 1222 microversion: 2.1 time: 0.388644 Oct 29 01:29:20.748041 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 28/49] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:29:20 2021] GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c => generated 1222 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:20.754744 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-954a2e5f-72a3-4e2e-bc88-32c292e245d5 tempest-VolumesSnapshotsTestJSON-285716011 tempest-VolumesSnapshotsTestJSON-285716011-project] Calling method '.version_select at 0x7ff62c47c820>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:21.173218 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.wsgi [None req-954a2e5f-72a3-4e2e-bc88-32c292e245d5 tempest-VolumesSnapshotsTestJSON-285716011 tempest-VolumesSnapshotsTestJSON-285716011-project] HTTP exception thrown: Volume e0403cd5-c5c8-4b5c-9d5e-8688ee4e4bb5 could not be found. Oct 29 01:29:21.173218 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-954a2e5f-72a3-4e2e-bc88-32c292e245d5 tempest-VolumesSnapshotsTestJSON-285716011 tempest-VolumesSnapshotsTestJSON-285716011-project] Returning 404 to user: Volume e0403cd5-c5c8-4b5c-9d5e-8688ee4e4bb5 could not be found. {{(pid=116378) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:29:21.173218 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-954a2e5f-72a3-4e2e-bc88-32c292e245d5 tempest-VolumesSnapshotsTestJSON-285716011 tempest-VolumesSnapshotsTestJSON-285716011-project] 10.222.0.87 "GET /compute/v2.1/os-volumes/e0403cd5-c5c8-4b5c-9d5e-8688ee4e4bb5" status: 404 len: 109 microversion: 2.1 time: 0.417334 Oct 29 01:29:21.173218 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 29/50] 10.222.0.87 () {58 vars in 1244 bytes} [Fri Oct 29 01:29:20 2021] GET /compute/v2.1/os-volumes/e0403cd5-c5c8-4b5c-9d5e-8688ee4e4bb5 => generated 109 bytes in 419 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:29:21.177418 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-0ec4a6ea-9f01-4143-b73a-84db85043266 tempest-VolumesSnapshotsTestJSON-285716011 tempest-VolumesSnapshotsTestJSON-285716011-project] Calling method '.version_select at 0x7ff62c47cb80>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:21.318299 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-90f58e45-ced7-4ce4-9074-4e6aa9d8c0ac tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df16eb9ac1b7472ebe95d3739604e27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1a96bc2154de787f2d217b2ac27f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:21.326970 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-90f58e45-ced7-4ce4-9074-4e6aa9d8c0ac tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] 10.222.0.87 "GET /compute/v2.1/servers/52d47b4c-e32e-4708-ade4-0be86b270c03" status: 200 len: 1314 microversion: 2.1 time: 0.940834 Oct 29 01:29:21.355474 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 22/51] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:29:20 2021] GET /compute/v2.1/servers/52d47b4c-e32e-4708-ade4-0be86b270c03 => generated 1314 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:29:21.759941 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-2273705e-40b2-448c-87c5-5c11b014240c tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:21.760598 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-2273705e-40b2-448c-87c5-5c11b014240c tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 8daa36f8-7d64-4d9d-94e6-0519848d4a2c] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:21.763976 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.wsgi [None req-0ec4a6ea-9f01-4143-b73a-84db85043266 tempest-VolumesSnapshotsTestJSON-285716011 tempest-VolumesSnapshotsTestJSON-285716011-project] HTTP exception thrown: Volume e0403cd5-c5c8-4b5c-9d5e-8688ee4e4bb5 could not be found. Oct 29 01:29:21.770181 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-0ec4a6ea-9f01-4143-b73a-84db85043266 tempest-VolumesSnapshotsTestJSON-285716011 tempest-VolumesSnapshotsTestJSON-285716011-project] Returning 404 to user: Volume e0403cd5-c5c8-4b5c-9d5e-8688ee4e4bb5 could not be found. {{(pid=116378) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:29:21.770181 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-0ec4a6ea-9f01-4143-b73a-84db85043266 tempest-VolumesSnapshotsTestJSON-285716011 tempest-VolumesSnapshotsTestJSON-285716011-project] 10.222.0.87 "DELETE /compute/v2.1/os-volumes/e0403cd5-c5c8-4b5c-9d5e-8688ee4e4bb5" status: 404 len: 109 microversion: 2.1 time: 0.593665 Oct 29 01:29:21.770181 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 30/52] 10.222.0.87 () {58 vars in 1247 bytes} [Fri Oct 29 01:29:21 2021] DELETE /compute/v2.1/os-volumes/e0403cd5-c5c8-4b5c-9d5e-8688ee4e4bb5 => generated 109 bytes in 595 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 01:29:21.775056 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-87750583-7c6f-4ab1-ae33-ff54ae17d101 tempest-VolumesSnapshotsTestJSON-285716011 tempest-VolumesSnapshotsTestJSON-285716011-project] Calling method '.version_select at 0x7ff62c480670>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:21.913656 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-2273705e-40b2-448c-87c5-5c11b014240c tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:21.921644 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-2273705e-40b2-448c-87c5-5c11b014240c tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c" status: 200 len: 1222 microversion: 2.1 time: 0.165596 Oct 29 01:29:21.941940 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 23/53] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:29:21 2021] GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c => generated 1222 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:29:22.098611 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.wsgi [None req-87750583-7c6f-4ab1-ae33-ff54ae17d101 tempest-VolumesSnapshotsTestJSON-285716011 tempest-VolumesSnapshotsTestJSON-285716011-project] HTTP exception thrown: Volume e0403cd5-c5c8-4b5c-9d5e-8688ee4e4bb5 could not be found. Oct 29 01:29:22.105633 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-87750583-7c6f-4ab1-ae33-ff54ae17d101 tempest-VolumesSnapshotsTestJSON-285716011 tempest-VolumesSnapshotsTestJSON-285716011-project] Returning 404 to user: Volume e0403cd5-c5c8-4b5c-9d5e-8688ee4e4bb5 could not be found. {{(pid=116378) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:29:22.105633 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-87750583-7c6f-4ab1-ae33-ff54ae17d101 tempest-VolumesSnapshotsTestJSON-285716011 tempest-VolumesSnapshotsTestJSON-285716011-project] 10.222.0.87 "GET /compute/v2.1/os-volumes/e0403cd5-c5c8-4b5c-9d5e-8688ee4e4bb5" status: 404 len: 109 microversion: 2.1 time: 0.329180 Oct 29 01:29:22.105633 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 31/54] 10.222.0.87 () {58 vars in 1244 bytes} [Fri Oct 29 01:29:21 2021] GET /compute/v2.1/os-volumes/e0403cd5-c5c8-4b5c-9d5e-8688ee4e4bb5 => generated 109 bytes in 331 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 01:29:22.370111 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-c80d72d1-96a6-4eb0-9595-d72aa770ddc2 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:22.370790 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-c80d72d1-96a6-4eb0-9595-d72aa770ddc2 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] [instance: 52d47b4c-e32e-4708-ade4-0be86b270c03] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:22.383490 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-c80d72d1-96a6-4eb0-9595-d72aa770ddc2 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:22.384065 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-c80d72d1-96a6-4eb0-9595-d72aa770ddc2 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:22.384844 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-c80d72d1-96a6-4eb0-9595-d72aa770ddc2 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:22.385283 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-c80d72d1-96a6-4eb0-9595-d72aa770ddc2 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:22.779257 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-3c0c027a-d11a-4e92-99bb-4b0c20042c45 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1928251904", "imageRef": "3b1d5dc6-2b04-4433-9a93-1db6a740092b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "598c8fe0-c1fa-4706-88a3-f2e6ce25e99c"}], "security_groups": [{"name": "tempest-securitygroup--1826472245"}], "key_name": "tempest-keypair-1364222965", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:29:23.392502 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.network.neutron [None req-3c0c027a-d11a-4e92-99bb-4b0c20042c45 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] validate_networks() for [('598c8fe0-c1fa-4706-88a3-f2e6ce25e99c', None, None, None, None, None)] {{(pid=116378) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 29 01:29:23.788152 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-c80d72d1-96a6-4eb0-9595-d72aa770ddc2 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df16eb9ac1b7472ebe95d3739604e27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1a96bc2154de787f2d217b2ac27f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:23.799967 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-c80d72d1-96a6-4eb0-9595-d72aa770ddc2 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] 10.222.0.87 "GET /compute/v2.1/servers/52d47b4c-e32e-4708-ade4-0be86b270c03" status: 200 len: 1314 microversion: 2.1 time: 1.434170 Oct 29 01:29:23.819601 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 24/55] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:29:22 2021] GET /compute/v2.1/servers/52d47b4c-e32e-4708-ade4-0be86b270c03 => generated 1314 bytes in 1453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:23.829416 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-2aebc98e-2e75-49f4-a11a-cf6a43d246b5 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:23.830038 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-2aebc98e-2e75-49f4-a11a-cf6a43d246b5 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 8daa36f8-7d64-4d9d-94e6-0519848d4a2c] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:23.856504 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-2aebc98e-2e75-49f4-a11a-cf6a43d246b5 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:23.864394 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-2aebc98e-2e75-49f4-a11a-cf6a43d246b5 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:23.864394 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-2aebc98e-2e75-49f4-a11a-cf6a43d246b5 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:23.864924 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-2aebc98e-2e75-49f4-a11a-cf6a43d246b5 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:24.110511 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-2aebc98e-2e75-49f4-a11a-cf6a43d246b5 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:24.121056 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-2aebc98e-2e75-49f4-a11a-cf6a43d246b5 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c" status: 200 len: 1274 microversion: 2.1 time: 0.300079 Oct 29 01:29:24.140693 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 25/56] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:29:23 2021] GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c => generated 1274 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:24.174860 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-7346010f-00e4-4e85-a05e-f23ced8fa7e5 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1805852754", "imageRef": "3b1d5dc6-2b04-4433-9a93-1db6a740092b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "83a007f6-bd8f-4f0b-a900-af58d53d6b5a"}], "security_groups": [{"name": "tempest-securitygroup--501577116"}], "key_name": "tempest-keypair-668136227", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:29:24.483268 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.network.neutron [None req-7346010f-00e4-4e85-a05e-f23ced8fa7e5 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] validate_networks() for [('83a007f6-bd8f-4f0b-a900-af58d53d6b5a', None, None, None, None, None)] {{(pid=116379) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 29 01:29:25.326103 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.virt.hardware [None req-3c0c027a-d11a-4e92-99bb-4b0c20042c45 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Flavor limits 0:0:0 {{(pid=116378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:29:25.326636 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.virt.hardware [None req-3c0c027a-d11a-4e92-99bb-4b0c20042c45 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Image limits 0:0:0 {{(pid=116378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:29:25.327915 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.virt.hardware [None req-3c0c027a-d11a-4e92-99bb-4b0c20042c45 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Flavor pref 0:0:0 {{(pid=116378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:29:25.328380 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.virt.hardware [None req-3c0c027a-d11a-4e92-99bb-4b0c20042c45 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Image pref 0:0:0 {{(pid=116378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:29:25.328787 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.virt.hardware [None req-3c0c027a-d11a-4e92-99bb-4b0c20042c45 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:29:25.340453 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-3c0c027a-d11a-4e92-99bb-4b0c20042c45 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:25.340929 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-3c0c027a-d11a-4e92-99bb-4b0c20042c45 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:25.342747 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-3c0c027a-d11a-4e92-99bb-4b0c20042c45 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:25.343519 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-3c0c027a-d11a-4e92-99bb-4b0c20042c45 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:25.369560 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.quota [None req-3c0c027a-d11a-4e92-99bb-4b0c20042c45 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Getting quotas for project c51a2093a0874d52a08f6e25489ba181. Resources: {'instances', 'cores', 'ram'} {{(pid=116378) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 01:29:25.376875 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.quota [None req-3c0c027a-d11a-4e92-99bb-4b0c20042c45 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Getting quotas for user 045dda1ff9b44334954c08e63fcd20c0 and project c51a2093a0874d52a08f6e25489ba181. Resources: {'instances', 'cores', 'ram'} {{(pid=116378) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 01:29:25.402534 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-3c0c027a-d11a-4e92-99bb-4b0c20042c45 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Going to run 1 instances... {{(pid=116378) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 29 01:29:25.405167 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-3c0c027a-d11a-4e92-99bb-4b0c20042c45 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3b1d5dc6-2b04-4433-9a93-1db6a740092b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116378) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 29 01:29:25.597883 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-3c0c027a-d11a-4e92-99bb-4b0c20042c45 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.823284 Oct 29 01:29:25.599122 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 32/57] 10.222.0.87 () {60 vars in 1146 bytes} [Fri Oct 29 01:29:22 2021] POST /compute/v2.1/servers => generated 402 bytes in 2825 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:29:25.608399 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-d35ecec5-4e07-4d7f-a45f-7b0b35801f46 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:25.609368 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-d35ecec5-4e07-4d7f-a45f-7b0b35801f46 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] [instance: 52d47b4c-e32e-4708-ade4-0be86b270c03] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:25.617229 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-d35ecec5-4e07-4d7f-a45f-7b0b35801f46 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:25.619424 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-d35ecec5-4e07-4d7f-a45f-7b0b35801f46 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:25.621094 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-d35ecec5-4e07-4d7f-a45f-7b0b35801f46 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:25.622033 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-d35ecec5-4e07-4d7f-a45f-7b0b35801f46 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:25.667365 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.virt.hardware [None req-7346010f-00e4-4e85-a05e-f23ced8fa7e5 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Flavor limits 0:0:0 {{(pid=116379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:29:25.667926 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.virt.hardware [None req-7346010f-00e4-4e85-a05e-f23ced8fa7e5 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Image limits 0:0:0 {{(pid=116379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:29:25.668278 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.virt.hardware [None req-7346010f-00e4-4e85-a05e-f23ced8fa7e5 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Flavor pref 0:0:0 {{(pid=116379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:29:25.668690 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.virt.hardware [None req-7346010f-00e4-4e85-a05e-f23ced8fa7e5 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Image pref 0:0:0 {{(pid=116379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:29:25.669139 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.virt.hardware [None req-7346010f-00e4-4e85-a05e-f23ced8fa7e5 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:29:25.684847 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-7346010f-00e4-4e85-a05e-f23ced8fa7e5 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:25.685301 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-7346010f-00e4-4e85-a05e-f23ced8fa7e5 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:25.686148 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-7346010f-00e4-4e85-a05e-f23ced8fa7e5 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:25.686573 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-7346010f-00e4-4e85-a05e-f23ced8fa7e5 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:25.713815 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.quota [None req-7346010f-00e4-4e85-a05e-f23ced8fa7e5 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Getting quotas for project 413ce1a7d8504d0b9f656d9e623f9005. Resources: {'instances', 'cores', 'ram'} {{(pid=116379) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 01:29:25.718722 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.quota [None req-7346010f-00e4-4e85-a05e-f23ced8fa7e5 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Getting quotas for user 78823bdcff4e45d8ab82558b434f188d and project 413ce1a7d8504d0b9f656d9e623f9005. Resources: {'instances', 'cores', 'ram'} {{(pid=116379) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 01:29:25.918806 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-7346010f-00e4-4e85-a05e-f23ced8fa7e5 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Going to run 1 instances... {{(pid=116379) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 29 01:29:25.918806 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-7346010f-00e4-4e85-a05e-f23ced8fa7e5 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3b1d5dc6-2b04-4433-9a93-1db6a740092b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116379) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 29 01:29:26.010522 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-d35ecec5-4e07-4d7f-a45f-7b0b35801f46 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df16eb9ac1b7472ebe95d3739604e27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1a96bc2154de787f2d217b2ac27f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:26.019264 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-d35ecec5-4e07-4d7f-a45f-7b0b35801f46 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] 10.222.0.87 "GET /compute/v2.1/servers/52d47b4c-e32e-4708-ade4-0be86b270c03" status: 200 len: 1314 microversion: 2.1 time: 0.418792 Oct 29 01:29:26.030994 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 33/58] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:29:25 2021] GET /compute/v2.1/servers/52d47b4c-e32e-4708-ade4-0be86b270c03 => generated 1314 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:26.039222 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-06c33ecc-c514-40e6-84eb-0a939eed9a1f tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:26.039900 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-06c33ecc-c514-40e6-84eb-0a939eed9a1f tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 8daa36f8-7d64-4d9d-94e6-0519848d4a2c] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:26.051619 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-06c33ecc-c514-40e6-84eb-0a939eed9a1f tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:26.052118 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-06c33ecc-c514-40e6-84eb-0a939eed9a1f tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:26.052983 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-06c33ecc-c514-40e6-84eb-0a939eed9a1f tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:26.054247 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-06c33ecc-c514-40e6-84eb-0a939eed9a1f tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:26.432526 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-7346010f-00e4-4e85-a05e-f23ced8fa7e5 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.290442 Oct 29 01:29:26.434170 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 26/59] 10.222.0.87 () {62 vars in 1187 bytes} [Fri Oct 29 01:29:24 2021] POST /compute/v2.1/servers => generated 401 bytes in 2292 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 29 01:29:26.440708 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-c7648c1f-f2a6-483c-9067-43e94597b4f7 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:26.441589 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-c7648c1f-f2a6-483c-9067-43e94597b4f7 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:26.543131 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-06c33ecc-c514-40e6-84eb-0a939eed9a1f tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:26.560112 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-06c33ecc-c514-40e6-84eb-0a939eed9a1f tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c" status: 200 len: 1292 microversion: 2.1 time: 0.533943 Oct 29 01:29:26.566686 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 34/60] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:29:26 2021] GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c => generated 1292 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:26.586488 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-bdb88e11-24c1-4638-8934-f051f78816c5 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:26.587041 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-bdb88e11-24c1-4638-8934-f051f78816c5 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:26.657658 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-c7648c1f-f2a6-483c-9067-43e94597b4f7 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045dda1ff9b44334954c08e63fcd20c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51a2093a0874d52a08f6e25489ba181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:26.672044 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-c7648c1f-f2a6-483c-9067-43e94597b4f7 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92" status: 200 len: 1238 microversion: 2.1 time: 0.230027 Oct 29 01:29:26.673450 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 27/61] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:29:26 2021] GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92 => generated 1238 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:27.044259 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-51583c60-5fdd-416c-8b1e-23604d304373 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:27.045053 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-51583c60-5fdd-416c-8b1e-23604d304373 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] [instance: 52d47b4c-e32e-4708-ade4-0be86b270c03] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:27.055480 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-51583c60-5fdd-416c-8b1e-23604d304373 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:27.063089 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-51583c60-5fdd-416c-8b1e-23604d304373 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:27.063089 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-51583c60-5fdd-416c-8b1e-23604d304373 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:27.063089 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-51583c60-5fdd-416c-8b1e-23604d304373 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:27.194455 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-bdb88e11-24c1-4638-8934-f051f78816c5 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:27.215753 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-bdb88e11-24c1-4638-8934-f051f78816c5 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:27.220346 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-bdb88e11-24c1-4638-8934-f051f78816c5 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:27.272730 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-bdb88e11-24c1-4638-8934-f051f78816c5 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1281 microversion: 2.20 time: 0.653224 Oct 29 01:29:27.272730 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 35/62] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:29:26 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1281 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:29:27.435864 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-51583c60-5fdd-416c-8b1e-23604d304373 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df16eb9ac1b7472ebe95d3739604e27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1a96bc2154de787f2d217b2ac27f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:27.458358 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-51583c60-5fdd-416c-8b1e-23604d304373 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] 10.222.0.87 "GET /compute/v2.1/servers/52d47b4c-e32e-4708-ade4-0be86b270c03" status: 200 len: 1314 microversion: 2.1 time: 0.419510 Oct 29 01:29:27.459309 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 28/63] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:29:27 2021] GET /compute/v2.1/servers/52d47b4c-e32e-4708-ade4-0be86b270c03 => generated 1314 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:27.582231 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-6b002ee3-0cfa-49bd-92b8-e5af8c8e000b tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:27.584158 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-6b002ee3-0cfa-49bd-92b8-e5af8c8e000b tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 8daa36f8-7d64-4d9d-94e6-0519848d4a2c] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:27.596253 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-6b002ee3-0cfa-49bd-92b8-e5af8c8e000b tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:27.596734 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-6b002ee3-0cfa-49bd-92b8-e5af8c8e000b tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:27.597717 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-6b002ee3-0cfa-49bd-92b8-e5af8c8e000b tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:27.598548 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-6b002ee3-0cfa-49bd-92b8-e5af8c8e000b tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:27.704307 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-0b46dab1-6d5f-4e7b-a00e-d9e3d2fc3b6c tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:27.709874 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-0b46dab1-6d5f-4e7b-a00e-d9e3d2fc3b6c tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:27.977757 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-0b46dab1-6d5f-4e7b-a00e-d9e3d2fc3b6c tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045dda1ff9b44334954c08e63fcd20c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51a2093a0874d52a08f6e25489ba181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:27.977757 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-0b46dab1-6d5f-4e7b-a00e-d9e3d2fc3b6c tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92" status: 200 len: 1238 microversion: 2.1 time: 0.238923 Oct 29 01:29:27.977757 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 29/64] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:29:27 2021] GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92 => generated 1238 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:28.037761 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-6b002ee3-0cfa-49bd-92b8-e5af8c8e000b tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:28.048582 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-6b002ee3-0cfa-49bd-92b8-e5af8c8e000b tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c" status: 200 len: 1322 microversion: 2.1 time: 0.472775 Oct 29 01:29:28.049545 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 36/65] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:29:27 2021] GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c => generated 1322 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:28.284991 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-96ac501b-41a8-469d-8c0a-c95a1281ec46 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:28.285640 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-96ac501b-41a8-469d-8c0a-c95a1281ec46 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:28.386932 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-96ac501b-41a8-469d-8c0a-c95a1281ec46 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:28.397681 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-96ac501b-41a8-469d-8c0a-c95a1281ec46 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:28.400559 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-96ac501b-41a8-469d-8c0a-c95a1281ec46 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:28.402622 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-96ac501b-41a8-469d-8c0a-c95a1281ec46 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1281 microversion: 2.20 time: 0.127135 Oct 29 01:29:28.405412 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 37/66] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:29:28 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1281 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:29:28.438271 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-49bfb1f2-2aa2-4474-9d46-88a9bad0c7a6 tempest-VolumesGetTestJSON-43640190 tempest-VolumesGetTestJSON-43640190-project] Action: 'create', calling method: .version_select at 0x7ff62cc901f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1664340702", "metadata": {"Type": "work"}}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:29:28.479055 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-4ebe54cf-59da-4ab0-ad3c-c96731b72e29 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:28.479817 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-4ebe54cf-59da-4ab0-ad3c-c96731b72e29 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] [instance: 52d47b4c-e32e-4708-ade4-0be86b270c03] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:28.496369 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4ebe54cf-59da-4ab0-ad3c-c96731b72e29 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:28.496833 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4ebe54cf-59da-4ab0-ad3c-c96731b72e29 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:28.497639 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4ebe54cf-59da-4ab0-ad3c-c96731b72e29 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:28.498999 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4ebe54cf-59da-4ab0-ad3c-c96731b72e29 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:28.812297 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-4ebe54cf-59da-4ab0-ad3c-c96731b72e29 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df16eb9ac1b7472ebe95d3739604e27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1a96bc2154de787f2d217b2ac27f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:28.829733 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-4ebe54cf-59da-4ab0-ad3c-c96731b72e29 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] 10.222.0.87 "GET /compute/v2.1/servers/52d47b4c-e32e-4708-ade4-0be86b270c03" status: 200 len: 1314 microversion: 2.1 time: 0.349551 Oct 29 01:29:28.829733 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 38/67] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:29:28 2021] GET /compute/v2.1/servers/52d47b4c-e32e-4708-ade4-0be86b270c03 => generated 1314 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:29:28.993670 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-98dff947-14ed-4e0d-b2e9-21378ac204a0 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:28.999100 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-98dff947-14ed-4e0d-b2e9-21378ac204a0 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:29.008067 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-98dff947-14ed-4e0d-b2e9-21378ac204a0 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:29.008523 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-98dff947-14ed-4e0d-b2e9-21378ac204a0 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:29.009305 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-98dff947-14ed-4e0d-b2e9-21378ac204a0 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:29.009903 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-98dff947-14ed-4e0d-b2e9-21378ac204a0 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:29.212419 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-98dff947-14ed-4e0d-b2e9-21378ac204a0 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045dda1ff9b44334954c08e63fcd20c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51a2093a0874d52a08f6e25489ba181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:29.238477 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-98dff947-14ed-4e0d-b2e9-21378ac204a0 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92" status: 200 len: 1242 microversion: 2.1 time: 0.248566 Oct 29 01:29:29.259857 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 39/68] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:29:28 2021] GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92 => generated 1242 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:29.260853 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-2896c784-c7d0-4565-89e5-91fea04777ed tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:29.261180 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-2896c784-c7d0-4565-89e5-91fea04777ed tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 8daa36f8-7d64-4d9d-94e6-0519848d4a2c] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:29.282041 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-2896c784-c7d0-4565-89e5-91fea04777ed tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:29.283302 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-2896c784-c7d0-4565-89e5-91fea04777ed tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:29.284272 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-2896c784-c7d0-4565-89e5-91fea04777ed tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:29.288450 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-2896c784-c7d0-4565-89e5-91fea04777ed tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:29.576752 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-2896c784-c7d0-4565-89e5-91fea04777ed tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:29.591876 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-2896c784-c7d0-4565-89e5-91fea04777ed tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c" status: 200 len: 1322 microversion: 2.1 time: 0.332069 Oct 29 01:29:29.591876 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 40/69] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:29:29 2021] GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c => generated 1322 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:29.662875 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [req-339bb4d8-1ae2-46da-ac68-78cd4ac13274 req-3ee68150-1dc8-4bec-87e8-3f96cf0897b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09875e40-e63d-4175-9361-fd9439c0c7ca", "tag": "ccaf14e9-30a4-4d96-9861-9c9c8b5e2172"}]} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:29:29.664464 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:29:29.664464 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: warnings.warn(msg) Oct 29 01:29:29.676564 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [req-339bb4d8-1ae2-46da-ac68-78cd4ac13274 req-3ee68150-1dc8-4bec-87e8-3f96cf0897b8 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:29.692135 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [req-339bb4d8-1ae2-46da-ac68-78cd4ac13274 req-3ee68150-1dc8-4bec-87e8-3f96cf0897b8 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:29.700612 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.compute.server_external_events [req-339bb4d8-1ae2-46da-ac68-78cd4ac13274 req-3ee68150-1dc8-4bec-87e8-3f96cf0897b8 service nova] Creating event network-changed:ccaf14e9-30a4-4d96-9861-9c9c8b5e2172 for instance 09875e40-e63d-4175-9361-fd9439c0c7ca on hv-cinder-81398 Oct 29 01:29:29.707776 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [req-339bb4d8-1ae2-46da-ac68-78cd4ac13274 req-3ee68150-1dc8-4bec-87e8-3f96cf0897b8 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116755 Oct 29 01:29:29.708879 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 41/70] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Oct 29 01:29:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:29:29.726701 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-cb63c3ca-22f0-4f27-9268-f84900d0fa3e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:29.727409 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-cb63c3ca-22f0-4f27-9268-f84900d0fa3e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:29.733885 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-cb63c3ca-22f0-4f27-9268-f84900d0fa3e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:29.734560 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-cb63c3ca-22f0-4f27-9268-f84900d0fa3e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:29.735350 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-cb63c3ca-22f0-4f27-9268-f84900d0fa3e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:29.735811 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-cb63c3ca-22f0-4f27-9268-f84900d0fa3e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:29.824997 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-cb63c3ca-22f0-4f27-9268-f84900d0fa3e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:29.833795 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-cb63c3ca-22f0-4f27-9268-f84900d0fa3e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:29.835295 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-cb63c3ca-22f0-4f27-9268-f84900d0fa3e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:29.836992 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-cb63c3ca-22f0-4f27-9268-f84900d0fa3e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1285 microversion: 2.20 time: 0.126799 Oct 29 01:29:29.837719 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 42/71] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:29:29 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1285 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:29:29.860354 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-fd48a1d2-9112-4df3-911e-0aaabacc0aa3 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:29.871997 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-fd48a1d2-9112-4df3-911e-0aaabacc0aa3 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] [instance: 52d47b4c-e32e-4708-ade4-0be86b270c03] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:29.871997 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-fd48a1d2-9112-4df3-911e-0aaabacc0aa3 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:29.871997 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-fd48a1d2-9112-4df3-911e-0aaabacc0aa3 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:29.871997 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-fd48a1d2-9112-4df3-911e-0aaabacc0aa3 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:29.872811 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-fd48a1d2-9112-4df3-911e-0aaabacc0aa3 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:30.027448 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-fd48a1d2-9112-4df3-911e-0aaabacc0aa3 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df16eb9ac1b7472ebe95d3739604e27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1a96bc2154de787f2d217b2ac27f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:30.037424 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-fd48a1d2-9112-4df3-911e-0aaabacc0aa3 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] 10.222.0.87 "GET /compute/v2.1/servers/52d47b4c-e32e-4708-ade4-0be86b270c03" status: 200 len: 1314 microversion: 2.1 time: 0.198622 Oct 29 01:29:30.037984 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 43/72] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:29:29 2021] GET /compute/v2.1/servers/52d47b4c-e32e-4708-ade4-0be86b270c03 => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:30.293361 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-49bfb1f2-2aa2-4474-9d46-88a9bad0c7a6 tempest-VolumesGetTestJSON-43640190 tempest-VolumesGetTestJSON-43640190-project] 10.222.0.87 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 2.356783 Oct 29 01:29:30.294771 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 30/73] 10.222.0.87 () {60 vars in 1155 bytes} [Fri Oct 29 01:29:27 2021] POST /compute/v2.1/os-volumes => generated 353 bytes in 2359 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 29 01:29:30.308024 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-3cc05590-afbc-4c7a-a508-13c5cb0491c9 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:30.310034 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-3cc05590-afbc-4c7a-a508-13c5cb0491c9 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:30.324213 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-3cc05590-afbc-4c7a-a508-13c5cb0491c9 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:30.324837 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-3cc05590-afbc-4c7a-a508-13c5cb0491c9 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:30.325803 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-3cc05590-afbc-4c7a-a508-13c5cb0491c9 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:30.326234 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-3cc05590-afbc-4c7a-a508-13c5cb0491c9 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:30.368741 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-36c2c748-793b-43aa-8726-67ed9581b274 tempest-VolumesNegativeTest-43601988 tempest-VolumesNegativeTest-43601988-project] Action: 'create', calling method: .version_select at 0x7ff62c3d7ee0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1423920368", "metadata": {"Type": "work"}}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:29:30.370165 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-36c2c748-793b-43aa-8726-67ed9581b274 tempest-VolumesNegativeTest-43601988 tempest-VolumesNegativeTest-43601988-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=116378) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:29:30.371027 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-36c2c748-793b-43aa-8726-67ed9581b274 tempest-VolumesNegativeTest-43601988 tempest-VolumesNegativeTest-43601988-project] 10.222.0.87 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.332085 Oct 29 01:29:30.371602 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 44/74] 10.222.0.87 () {60 vars in 1155 bytes} [Fri Oct 29 01:29:30 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 333 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 01:29:30.376158 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-0427c2dd-ce74-4bc6-9446-26e7496b14e0 tempest-VolumesGetTestJSON-43640190 tempest-VolumesGetTestJSON-43640190-project] Calling method '.version_select at 0x7ff62c4ee160>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:30.397576 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-3cc05590-afbc-4c7a-a508-13c5cb0491c9 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045dda1ff9b44334954c08e63fcd20c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51a2093a0874d52a08f6e25489ba181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:30.406182 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-3cc05590-afbc-4c7a-a508-13c5cb0491c9 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92" status: 200 len: 1242 microversion: 2.1 time: 0.109037 Oct 29 01:29:30.410948 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 31/75] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:29:30 2021] GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92 => generated 1242 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:30.412797 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-2ac16612-2c9f-4b11-b9ff-9536fcdd64ee tempest-VolumesNegativeTest-43601988 tempest-VolumesNegativeTest-43601988-project] Action: 'create', calling method: .version_select at 0x7ff62cd0caf0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1474867634", "metadata": {"Type": "work"}}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:29:30.414897 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-2ac16612-2c9f-4b11-b9ff-9536fcdd64ee tempest-VolumesNegativeTest-43601988 tempest-VolumesNegativeTest-43601988-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=116379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:29:30.415980 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-2ac16612-2c9f-4b11-b9ff-9536fcdd64ee tempest-VolumesNegativeTest-43601988 tempest-VolumesNegativeTest-43601988-project] 10.222.0.87 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008206 Oct 29 01:29:30.417150 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 32/76] 10.222.0.87 () {60 vars in 1155 bytes} [Fri Oct 29 01:29:30 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 01:29:30.426870 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-7030f11e-ca73-4c25-8c09-c507472db47b tempest-VolumesNegativeTest-43601988 tempest-VolumesNegativeTest-43601988-project] Action: 'create', calling method: .version_select at 0x7ff62c443550>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-799334950", "metadata": {"Type": "work"}}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:29:30.428058 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-7030f11e-ca73-4c25-8c09-c507472db47b tempest-VolumesNegativeTest-43601988 tempest-VolumesNegativeTest-43601988-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=116379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:29:30.428863 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-7030f11e-ca73-4c25-8c09-c507472db47b tempest-VolumesNegativeTest-43601988 tempest-VolumesNegativeTest-43601988-project] 10.222.0.87 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.005936 Oct 29 01:29:30.429386 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 33/77] 10.222.0.87 () {60 vars in 1155 bytes} [Fri Oct 29 01:29:30 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 29 01:29:30.434919 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-0427c2dd-ce74-4bc6-9446-26e7496b14e0 tempest-VolumesGetTestJSON-43640190 tempest-VolumesGetTestJSON-43640190-project] 10.222.0.87 "GET /compute/v2.1/os-volumes/00870247-a21d-4780-a04c-7d414287fb87" status: 200 len: 353 microversion: 2.1 time: 0.062227 Oct 29 01:29:30.439027 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-85231089-312d-4430-8a96-e78e74dfaf09 tempest-VolumesNegativeTest-43601988 tempest-VolumesNegativeTest-43601988-project] Calling method '.version_select at 0x7ff62c443b80>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:30.440846 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 45/78] 10.222.0.87 () {58 vars in 1244 bytes} [Fri Oct 29 01:29:30 2021] GET /compute/v2.1/os-volumes/00870247-a21d-4780-a04c-7d414287fb87 => generated 353 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:29:30.481905 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.wsgi [None req-85231089-312d-4430-8a96-e78e74dfaf09 tempest-VolumesNegativeTest-43601988 tempest-VolumesNegativeTest-43601988-project] HTTP exception thrown: Volume tempest-invalid-506730058 could not be found. Oct 29 01:29:30.482502 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-85231089-312d-4430-8a96-e78e74dfaf09 tempest-VolumesNegativeTest-43601988 tempest-VolumesNegativeTest-43601988-project] Returning 404 to user: Volume tempest-invalid-506730058 could not be found. {{(pid=116379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:29:30.483331 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-85231089-312d-4430-8a96-e78e74dfaf09 tempest-VolumesNegativeTest-43601988 tempest-VolumesNegativeTest-43601988-project] 10.222.0.87 "DELETE /compute/v2.1/os-volumes/tempest-invalid-506730058" status: 404 len: 98 microversion: 2.1 time: 0.048570 Oct 29 01:29:30.483892 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 34/79] 10.222.0.87 () {58 vars in 1214 bytes} [Fri Oct 29 01:29:30 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-506730058 => generated 98 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 01:29:30.493422 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-69a61fba-1c36-4b11-9bb2-69021d382fef tempest-VolumesNegativeTest-43601988 tempest-VolumesNegativeTest-43601988-project] 10.222.0.87 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003673 Oct 29 01:29:30.502940 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 46/80] 10.222.0.87 () {58 vars in 1139 bytes} [Fri Oct 29 01:29:30 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 29 01:29:30.510169 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-b672b429-6a96-4a4a-a3f4-55d363c0b0ae tempest-VolumesNegativeTest-43601988 tempest-VolumesNegativeTest-43601988-project] 10.222.0.87 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003513 Oct 29 01:29:30.510659 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 35/81] 10.222.0.87 () {58 vars in 1136 bytes} [Fri Oct 29 01:29:30 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 29 01:29:30.519453 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-b0002845-6908-4521-a99b-a66089f66010 tempest-VolumesNegativeTest-43601988 tempest-VolumesNegativeTest-43601988-project] Calling method '.version_select at 0x7ff62c4ee550>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:30.547458 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.wsgi [None req-b0002845-6908-4521-a99b-a66089f66010 tempest-VolumesNegativeTest-43601988 tempest-VolumesNegativeTest-43601988-project] HTTP exception thrown: Volume 6e604814-21e9-42c1-a318-d729db4a1454 could not be found. Oct 29 01:29:30.548086 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-b0002845-6908-4521-a99b-a66089f66010 tempest-VolumesNegativeTest-43601988 tempest-VolumesNegativeTest-43601988-project] Returning 404 to user: Volume 6e604814-21e9-42c1-a318-d729db4a1454 could not be found. {{(pid=116378) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:29:30.548940 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-b0002845-6908-4521-a99b-a66089f66010 tempest-VolumesNegativeTest-43601988 tempest-VolumesNegativeTest-43601988-project] 10.222.0.87 "DELETE /compute/v2.1/os-volumes/6e604814-21e9-42c1-a318-d729db4a1454" status: 404 len: 109 microversion: 2.1 time: 0.033684 Oct 29 01:29:30.549485 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 47/82] 10.222.0.87 () {58 vars in 1247 bytes} [Fri Oct 29 01:29:30 2021] DELETE /compute/v2.1/os-volumes/6e604814-21e9-42c1-a318-d729db4a1454 => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:29:30.558533 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-7bb4e362-576c-4416-acf4-297a11834d23 tempest-VolumesNegativeTest-43601988 tempest-VolumesNegativeTest-43601988-project] Calling method '.version_select at 0x7ff62cce0790>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:30.593157 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.wsgi [None req-7bb4e362-576c-4416-acf4-297a11834d23 tempest-VolumesNegativeTest-43601988 tempest-VolumesNegativeTest-43601988-project] HTTP exception thrown: Volume 2aa59101-185c-4d83-bc5d-d0436e5407ee could not be found. Oct 29 01:29:30.593789 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-7bb4e362-576c-4416-acf4-297a11834d23 tempest-VolumesNegativeTest-43601988 tempest-VolumesNegativeTest-43601988-project] Returning 404 to user: Volume 2aa59101-185c-4d83-bc5d-d0436e5407ee could not be found. {{(pid=116379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:29:30.594839 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-7bb4e362-576c-4416-acf4-297a11834d23 tempest-VolumesNegativeTest-43601988 tempest-VolumesNegativeTest-43601988-project] 10.222.0.87 "GET /compute/v2.1/os-volumes/2aa59101-185c-4d83-bc5d-d0436e5407ee" status: 404 len: 109 microversion: 2.1 time: 0.039874 Oct 29 01:29:30.595415 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 36/83] 10.222.0.87 () {58 vars in 1244 bytes} [Fri Oct 29 01:29:30 2021] GET /compute/v2.1/os-volumes/2aa59101-185c-4d83-bc5d-d0436e5407ee => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 01:29:30.606444 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-63f5bd90-9117-40c8-9056-a99ff01ce697 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:30.607053 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-63f5bd90-9117-40c8-9056-a99ff01ce697 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 8daa36f8-7d64-4d9d-94e6-0519848d4a2c] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:30.615028 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-63f5bd90-9117-40c8-9056-a99ff01ce697 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:30.615485 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-63f5bd90-9117-40c8-9056-a99ff01ce697 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:30.616317 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-63f5bd90-9117-40c8-9056-a99ff01ce697 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:30.616755 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-63f5bd90-9117-40c8-9056-a99ff01ce697 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:30.752950 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-63f5bd90-9117-40c8-9056-a99ff01ce697 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:30.760916 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-63f5bd90-9117-40c8-9056-a99ff01ce697 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c" status: 200 len: 1322 microversion: 2.1 time: 0.158334 Oct 29 01:29:30.761494 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 48/84] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:29:30 2021] GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:30.858792 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-a3ae3c39-b734-4df1-a0db-dee0827213ef tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:30.859349 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-a3ae3c39-b734-4df1-a0db-dee0827213ef tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:30.873696 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-a3ae3c39-b734-4df1-a0db-dee0827213ef tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:30.877326 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-a3ae3c39-b734-4df1-a0db-dee0827213ef tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:30.877326 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-a3ae3c39-b734-4df1-a0db-dee0827213ef tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:30.877326 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-a3ae3c39-b734-4df1-a0db-dee0827213ef tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:30.943717 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-a3ae3c39-b734-4df1-a0db-dee0827213ef tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:30.952026 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-a3ae3c39-b734-4df1-a0db-dee0827213ef tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:30.953510 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-a3ae3c39-b734-4df1-a0db-dee0827213ef tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:30.954648 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-a3ae3c39-b734-4df1-a0db-dee0827213ef tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1285 microversion: 2.20 time: 0.099980 Oct 29 01:29:30.955884 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 37/85] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:29:30 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:29:31.055067 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-93e33e44-ea48-4348-aa9e-251f4ef01f10 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:31.055695 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-93e33e44-ea48-4348-aa9e-251f4ef01f10 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] [instance: 52d47b4c-e32e-4708-ade4-0be86b270c03] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:31.061689 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-93e33e44-ea48-4348-aa9e-251f4ef01f10 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:31.062140 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-93e33e44-ea48-4348-aa9e-251f4ef01f10 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:31.062907 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-93e33e44-ea48-4348-aa9e-251f4ef01f10 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:31.063531 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-93e33e44-ea48-4348-aa9e-251f4ef01f10 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:31.223162 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-93e33e44-ea48-4348-aa9e-251f4ef01f10 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df16eb9ac1b7472ebe95d3739604e27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1a96bc2154de787f2d217b2ac27f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:31.237617 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-93e33e44-ea48-4348-aa9e-251f4ef01f10 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] 10.222.0.87 "GET /compute/v2.1/servers/52d47b4c-e32e-4708-ade4-0be86b270c03" status: 200 len: 1314 microversion: 2.1 time: 0.185488 Oct 29 01:29:31.238233 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 49/86] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:29:31 2021] GET /compute/v2.1/servers/52d47b4c-e32e-4708-ade4-0be86b270c03 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:31.425229 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-65be7bd5-9241-454c-9998-ab7a1c5e5345 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:31.426621 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-65be7bd5-9241-454c-9998-ab7a1c5e5345 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:31.432911 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-65be7bd5-9241-454c-9998-ab7a1c5e5345 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:31.433382 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-65be7bd5-9241-454c-9998-ab7a1c5e5345 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:31.434167 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-65be7bd5-9241-454c-9998-ab7a1c5e5345 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:31.434781 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-65be7bd5-9241-454c-9998-ab7a1c5e5345 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:31.447978 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-34b168d6-a547-49f9-9193-0de007658209 tempest-VolumesGetTestJSON-43640190 tempest-VolumesGetTestJSON-43640190-project] Calling method '.version_select at 0x7ff62c3d7790>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:31.515681 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-65be7bd5-9241-454c-9998-ab7a1c5e5345 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045dda1ff9b44334954c08e63fcd20c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51a2093a0874d52a08f6e25489ba181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:31.524586 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-65be7bd5-9241-454c-9998-ab7a1c5e5345 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92" status: 200 len: 1242 microversion: 2.1 time: 0.103682 Oct 29 01:29:31.525018 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 38/87] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:29:31 2021] GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92 => generated 1242 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:31.526904 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-34b168d6-a547-49f9-9193-0de007658209 tempest-VolumesGetTestJSON-43640190 tempest-VolumesGetTestJSON-43640190-project] 10.222.0.87 "GET /compute/v2.1/os-volumes/00870247-a21d-4780-a04c-7d414287fb87" status: 200 len: 354 microversion: 2.1 time: 0.082515 Oct 29 01:29:31.534357 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 50/88] 10.222.0.87 () {58 vars in 1244 bytes} [Fri Oct 29 01:29:31 2021] GET /compute/v2.1/os-volumes/00870247-a21d-4780-a04c-7d414287fb87 => generated 354 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:29:31.539891 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-7356a0d9-434a-4faf-bd13-45cb04eaf653 tempest-VolumesGetTestJSON-43640190 tempest-VolumesGetTestJSON-43640190-project] Calling method '.version_select at 0x7ff632946310>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:31.594491 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-7356a0d9-434a-4faf-bd13-45cb04eaf653 tempest-VolumesGetTestJSON-43640190 tempest-VolumesGetTestJSON-43640190-project] 10.222.0.87 "GET /compute/v2.1/os-volumes/00870247-a21d-4780-a04c-7d414287fb87" status: 200 len: 354 microversion: 2.1 time: 0.058177 Oct 29 01:29:31.595408 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 39/89] 10.222.0.87 () {58 vars in 1244 bytes} [Fri Oct 29 01:29:31 2021] GET /compute/v2.1/os-volumes/00870247-a21d-4780-a04c-7d414287fb87 => generated 354 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:29:31.619721 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-4797374b-5fd1-41bc-bad8-cba4653fb328 tempest-VolumesGetTestJSON-43640190 tempest-VolumesGetTestJSON-43640190-project] Calling method '.version_select at 0x7ff62c464ca0>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:31.781772 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-cc2fbba7-123e-4eae-87f0-d59dbbeac123 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:31.783412 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-cc2fbba7-123e-4eae-87f0-d59dbbeac123 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 8daa36f8-7d64-4d9d-94e6-0519848d4a2c] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:31.821146 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-cc2fbba7-123e-4eae-87f0-d59dbbeac123 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:31.822391 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-cc2fbba7-123e-4eae-87f0-d59dbbeac123 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:31.824042 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-cc2fbba7-123e-4eae-87f0-d59dbbeac123 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:31.826003 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-cc2fbba7-123e-4eae-87f0-d59dbbeac123 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:31.916875 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-4797374b-5fd1-41bc-bad8-cba4653fb328 tempest-VolumesGetTestJSON-43640190 tempest-VolumesGetTestJSON-43640190-project] 10.222.0.87 "DELETE /compute/v2.1/os-volumes/00870247-a21d-4780-a04c-7d414287fb87" status: 202 len: 0 microversion: 2.1 time: 0.307478 Oct 29 01:29:31.920633 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 51/90] 10.222.0.87 () {58 vars in 1247 bytes} [Fri Oct 29 01:29:31 2021] DELETE /compute/v2.1/os-volumes/00870247-a21d-4780-a04c-7d414287fb87 => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:29:31.927827 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-3c37d4d2-41a6-458a-82ea-fa185da54b58 tempest-VolumesGetTestJSON-43640190 tempest-VolumesGetTestJSON-43640190-project] Calling method '.version_select at 0x7ff62e0645e0>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:32.010887 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-3c37d4d2-41a6-458a-82ea-fa185da54b58 tempest-VolumesGetTestJSON-43640190 tempest-VolumesGetTestJSON-43640190-project] 10.222.0.87 "GET /compute/v2.1/os-volumes/00870247-a21d-4780-a04c-7d414287fb87" status: 200 len: 353 microversion: 2.1 time: 0.086693 Oct 29 01:29:32.018543 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 52/91] 10.222.0.87 () {58 vars in 1244 bytes} [Fri Oct 29 01:29:31 2021] GET /compute/v2.1/os-volumes/00870247-a21d-4780-a04c-7d414287fb87 => generated 353 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:29:32.029164 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-77c447a5-7948-4778-a296-f3622ae5205a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:32.030059 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-77c447a5-7948-4778-a296-f3622ae5205a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:32.040063 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-77c447a5-7948-4778-a296-f3622ae5205a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:32.040890 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-77c447a5-7948-4778-a296-f3622ae5205a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:32.041875 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-77c447a5-7948-4778-a296-f3622ae5205a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:32.042530 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-77c447a5-7948-4778-a296-f3622ae5205a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:32.149631 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-cc2fbba7-123e-4eae-87f0-d59dbbeac123 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:32.167173 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-77c447a5-7948-4778-a296-f3622ae5205a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:32.172847 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-cc2fbba7-123e-4eae-87f0-d59dbbeac123 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c" status: 200 len: 1322 microversion: 2.1 time: 0.394968 Oct 29 01:29:32.174506 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 40/92] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:29:31 2021] GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c => generated 1322 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:29:32.189056 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-77c447a5-7948-4778-a296-f3622ae5205a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:32.191539 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-77c447a5-7948-4778-a296-f3622ae5205a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:32.193029 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-77c447a5-7948-4778-a296-f3622ae5205a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1277 microversion: 2.20 time: 0.173252 Oct 29 01:29:32.194081 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 53/93] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:29:32 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1277 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:29:32.262511 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-e823e24b-7f93-4286-8d15-f17650cdc1de tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:32.264914 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-e823e24b-7f93-4286-8d15-f17650cdc1de tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] [instance: 52d47b4c-e32e-4708-ade4-0be86b270c03] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:32.283449 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-e823e24b-7f93-4286-8d15-f17650cdc1de tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:32.283449 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-e823e24b-7f93-4286-8d15-f17650cdc1de tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:32.283449 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-e823e24b-7f93-4286-8d15-f17650cdc1de tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:32.283449 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-e823e24b-7f93-4286-8d15-f17650cdc1de tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:32.541356 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-fd2da14b-13b4-4dd5-9748-5732a10694b3 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:32.546890 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-fd2da14b-13b4-4dd5-9748-5732a10694b3 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:32.549122 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-fd2da14b-13b4-4dd5-9748-5732a10694b3 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:32.549536 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-fd2da14b-13b4-4dd5-9748-5732a10694b3 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:32.551925 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-fd2da14b-13b4-4dd5-9748-5732a10694b3 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:32.552537 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-fd2da14b-13b4-4dd5-9748-5732a10694b3 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:32.562098 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-e823e24b-7f93-4286-8d15-f17650cdc1de tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df16eb9ac1b7472ebe95d3739604e27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1a96bc2154de787f2d217b2ac27f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:32.573031 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-e823e24b-7f93-4286-8d15-f17650cdc1de tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] 10.222.0.87 "GET /compute/v2.1/servers/52d47b4c-e32e-4708-ade4-0be86b270c03" status: 200 len: 1314 microversion: 2.1 time: 0.319979 Oct 29 01:29:32.573618 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 41/94] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:29:32 2021] GET /compute/v2.1/servers/52d47b4c-e32e-4708-ade4-0be86b270c03 => generated 1314 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:32.678938 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-fd2da14b-13b4-4dd5-9748-5732a10694b3 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045dda1ff9b44334954c08e63fcd20c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51a2093a0874d52a08f6e25489ba181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:32.686968 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-fd2da14b-13b4-4dd5-9748-5732a10694b3 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92" status: 200 len: 1234 microversion: 2.1 time: 0.149298 Oct 29 01:29:32.687720 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 54/95] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:29:32 2021] GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92 => generated 1234 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:32.843232 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [req-72935b7c-c628-4864-b262-ee27686461ec req-f468e2c9-94b3-4fd5-a193-37823ac72085 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8daa36f8-7d64-4d9d-94e6-0519848d4a2c", "tag": "8795097b-0746-4ca7-81ba-d053d48c81c2"}]} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:29:32.845793 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:29:32.845793 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: warnings.warn(msg) Oct 29 01:29:32.873326 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [req-72935b7c-c628-4864-b262-ee27686461ec req-f468e2c9-94b3-4fd5-a193-37823ac72085 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:32.875171 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [req-72935b7c-c628-4864-b262-ee27686461ec req-f468e2c9-94b3-4fd5-a193-37823ac72085 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:32.914382 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.compute.server_external_events [req-72935b7c-c628-4864-b262-ee27686461ec req-f468e2c9-94b3-4fd5-a193-37823ac72085 service nova] Creating event network-changed:8795097b-0746-4ca7-81ba-d053d48c81c2 for instance 8daa36f8-7d64-4d9d-94e6-0519848d4a2c on hv-cinder-81398 Oct 29 01:29:32.920071 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [req-72935b7c-c628-4864-b262-ee27686461ec req-f468e2c9-94b3-4fd5-a193-37823ac72085 service nova] Acquired lock "compute-rpcapi-router" {{(pid=116379) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Oct 29 01:29:32.920071 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-79ff7f41-c9e0-4142-8d02-1d97b67e2934 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:32.920071 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-79ff7f41-c9e0-4142-8d02-1d97b67e2934 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:32.920071 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-79ff7f41-c9e0-4142-8d02-1d97b67e2934 None None] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:32.920071 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-79ff7f41-c9e0-4142-8d02-1d97b67e2934 None None] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:32.930092 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.compute.rpcapi [None req-79ff7f41-c9e0-4142-8d02-1d97b67e2934 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Oct 29 01:29:32.931254 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-79ff7f41-c9e0-4142-8d02-1d97b67e2934 None None] Releasing lock "compute-rpcapi-router" {{(pid=116379) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Oct 29 01:29:32.975434 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-79ff7f41-c9e0-4142-8d02-1d97b67e2934 None None] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136052 Oct 29 01:29:32.979679 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 42/96] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Oct 29 01:29:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:29:33.026117 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-7d574767-d8bd-482e-bc68-4d897c78fcb0 tempest-VolumesGetTestJSON-43640190 tempest-VolumesGetTestJSON-43640190-project] Calling method '.version_select at 0x7ff62c4a9550>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:33.066707 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.wsgi [None req-7d574767-d8bd-482e-bc68-4d897c78fcb0 tempest-VolumesGetTestJSON-43640190 tempest-VolumesGetTestJSON-43640190-project] HTTP exception thrown: Volume 00870247-a21d-4780-a04c-7d414287fb87 could not be found. Oct 29 01:29:33.067327 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-7d574767-d8bd-482e-bc68-4d897c78fcb0 tempest-VolumesGetTestJSON-43640190 tempest-VolumesGetTestJSON-43640190-project] Returning 404 to user: Volume 00870247-a21d-4780-a04c-7d414287fb87 could not be found. {{(pid=116378) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:29:33.068191 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-7d574767-d8bd-482e-bc68-4d897c78fcb0 tempest-VolumesGetTestJSON-43640190 tempest-VolumesGetTestJSON-43640190-project] 10.222.0.87 "GET /compute/v2.1/os-volumes/00870247-a21d-4780-a04c-7d414287fb87" status: 404 len: 109 microversion: 2.1 time: 0.048166 Oct 29 01:29:33.068761 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 55/97] 10.222.0.87 () {58 vars in 1244 bytes} [Fri Oct 29 01:29:33 2021] GET /compute/v2.1/os-volumes/00870247-a21d-4780-a04c-7d414287fb87 => generated 109 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:29:33.193943 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-14492c5b-e2fc-4fe0-bb01-890db9e49cd1 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:33.194623 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-14492c5b-e2fc-4fe0-bb01-890db9e49cd1 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 8daa36f8-7d64-4d9d-94e6-0519848d4a2c] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:33.202289 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-14492c5b-e2fc-4fe0-bb01-890db9e49cd1 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:33.202766 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-14492c5b-e2fc-4fe0-bb01-890db9e49cd1 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:33.203593 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-14492c5b-e2fc-4fe0-bb01-890db9e49cd1 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:33.204396 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-14492c5b-e2fc-4fe0-bb01-890db9e49cd1 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:33.213349 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-880137a3-e27e-41cc-9648-cc2c8fca4ccc tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:33.214710 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-880137a3-e27e-41cc-9648-cc2c8fca4ccc tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:33.225226 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-880137a3-e27e-41cc-9648-cc2c8fca4ccc tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:33.225954 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-880137a3-e27e-41cc-9648-cc2c8fca4ccc tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:33.230447 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-880137a3-e27e-41cc-9648-cc2c8fca4ccc tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:33.234161 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-880137a3-e27e-41cc-9648-cc2c8fca4ccc tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:33.407678 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-880137a3-e27e-41cc-9648-cc2c8fca4ccc tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:33.420436 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-880137a3-e27e-41cc-9648-cc2c8fca4ccc tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:33.421776 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-880137a3-e27e-41cc-9648-cc2c8fca4ccc tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:33.423318 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-880137a3-e27e-41cc-9648-cc2c8fca4ccc tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1341 microversion: 2.20 time: 0.213698 Oct 29 01:29:33.424803 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 56/98] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:29:33 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1341 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:29:33.514764 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-14492c5b-e2fc-4fe0-bb01-890db9e49cd1 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:33.535123 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-14492c5b-e2fc-4fe0-bb01-890db9e49cd1 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c" status: 200 len: 1322 microversion: 2.1 time: 0.341499 Oct 29 01:29:33.536109 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 43/99] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:29:33 2021] GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c => generated 1322 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:33.600806 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-76fdd89c-4460-4e14-a6c6-1e1595566e22 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:33.602680 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-76fdd89c-4460-4e14-a6c6-1e1595566e22 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] [instance: 52d47b4c-e32e-4708-ade4-0be86b270c03] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:33.612925 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-76fdd89c-4460-4e14-a6c6-1e1595566e22 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:33.613562 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-76fdd89c-4460-4e14-a6c6-1e1595566e22 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:33.615322 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-76fdd89c-4460-4e14-a6c6-1e1595566e22 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:33.616032 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-76fdd89c-4460-4e14-a6c6-1e1595566e22 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:33.708738 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-2ac49268-303b-475e-be76-09d8c18902c8 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:33.709531 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-2ac49268-303b-475e-be76-09d8c18902c8 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:33.715899 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-2ac49268-303b-475e-be76-09d8c18902c8 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:33.716461 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-2ac49268-303b-475e-be76-09d8c18902c8 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:33.717318 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-2ac49268-303b-475e-be76-09d8c18902c8 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:33.717966 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-2ac49268-303b-475e-be76-09d8c18902c8 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:33.829054 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-2ac49268-303b-475e-be76-09d8c18902c8 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045dda1ff9b44334954c08e63fcd20c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51a2093a0874d52a08f6e25489ba181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:33.837775 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-2ac49268-303b-475e-be76-09d8c18902c8 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92" status: 200 len: 1290 microversion: 2.1 time: 0.134131 Oct 29 01:29:33.857688 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 44/100] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:29:33 2021] GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92 => generated 1290 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:33.866935 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-76fdd89c-4460-4e14-a6c6-1e1595566e22 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df16eb9ac1b7472ebe95d3739604e27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1a96bc2154de787f2d217b2ac27f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:33.879879 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-76fdd89c-4460-4e14-a6c6-1e1595566e22 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] 10.222.0.87 "GET /compute/v2.1/servers/52d47b4c-e32e-4708-ade4-0be86b270c03" status: 200 len: 1314 microversion: 2.1 time: 0.292836 Oct 29 01:29:33.892877 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 57/101] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:29:33 2021] GET /compute/v2.1/servers/52d47b4c-e32e-4708-ade4-0be86b270c03 => generated 1314 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:34.444591 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-40e98469-ef13-40dc-bafc-e5e1943d45d5 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:34.445831 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-40e98469-ef13-40dc-bafc-e5e1943d45d5 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:34.457308 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-40e98469-ef13-40dc-bafc-e5e1943d45d5 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:34.458491 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-40e98469-ef13-40dc-bafc-e5e1943d45d5 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:34.461553 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-40e98469-ef13-40dc-bafc-e5e1943d45d5 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:34.463315 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-40e98469-ef13-40dc-bafc-e5e1943d45d5 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:34.552882 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-4d4c132e-d960-4cef-838c-5cf84933a450 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:34.553492 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-4d4c132e-d960-4cef-838c-5cf84933a450 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 8daa36f8-7d64-4d9d-94e6-0519848d4a2c] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:34.559999 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4d4c132e-d960-4cef-838c-5cf84933a450 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:34.560929 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4d4c132e-d960-4cef-838c-5cf84933a450 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:34.562520 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4d4c132e-d960-4cef-838c-5cf84933a450 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:34.563267 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4d4c132e-d960-4cef-838c-5cf84933a450 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:35.254887 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-40e98469-ef13-40dc-bafc-e5e1943d45d5 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:35.262922 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-40e98469-ef13-40dc-bafc-e5e1943d45d5 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:35.264716 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-40e98469-ef13-40dc-bafc-e5e1943d45d5 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:35.265339 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-4d4c132e-d960-4cef-838c-5cf84933a450 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:35.265999 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-40e98469-ef13-40dc-bafc-e5e1943d45d5 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1406 microversion: 2.20 time: 0.827243 Oct 29 01:29:35.274386 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-4d4c132e-d960-4cef-838c-5cf84933a450 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c" status: 200 len: 1322 microversion: 2.1 time: 0.725859 Oct 29 01:29:35.284346 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 58/102] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:29:34 2021] GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c => generated 1322 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:29:35.284494 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 45/103] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:29:34 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1406 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:29:35.284590 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-c3dd28c6-09d4-4a37-93f0-beb28bc39cad tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:35.284590 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-c3dd28c6-09d4-4a37-93f0-beb28bc39cad tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:35.284719 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-618f85dd-4c25-4c13-8129-beea5c3a6703 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:35.284719 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-618f85dd-4c25-4c13-8129-beea5c3a6703 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] [instance: 52d47b4c-e32e-4708-ade4-0be86b270c03] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:35.289776 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-618f85dd-4c25-4c13-8129-beea5c3a6703 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:35.290225 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-618f85dd-4c25-4c13-8129-beea5c3a6703 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:35.291006 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-618f85dd-4c25-4c13-8129-beea5c3a6703 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:35.291220 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c3dd28c6-09d4-4a37-93f0-beb28bc39cad tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:35.291439 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-618f85dd-4c25-4c13-8129-beea5c3a6703 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:35.291879 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c3dd28c6-09d4-4a37-93f0-beb28bc39cad tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:35.292771 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c3dd28c6-09d4-4a37-93f0-beb28bc39cad tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:35.293276 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c3dd28c6-09d4-4a37-93f0-beb28bc39cad tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:35.398670 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-c3dd28c6-09d4-4a37-93f0-beb28bc39cad tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045dda1ff9b44334954c08e63fcd20c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51a2093a0874d52a08f6e25489ba181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:35.412563 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-c3dd28c6-09d4-4a37-93f0-beb28bc39cad tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92" status: 200 len: 1296 microversion: 2.1 time: 0.136425 Oct 29 01:29:35.414566 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 59/104] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:29:35 2021] GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92 => generated 1296 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:35.764233 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-618f85dd-4c25-4c13-8129-beea5c3a6703 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df16eb9ac1b7472ebe95d3739604e27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1a96bc2154de787f2d217b2ac27f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:35.778455 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-618f85dd-4c25-4c13-8129-beea5c3a6703 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] 10.222.0.87 "GET /compute/v2.1/servers/52d47b4c-e32e-4708-ade4-0be86b270c03" status: 200 len: 1314 microversion: 2.1 time: 0.499630 Oct 29 01:29:35.780490 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 46/105] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:29:35 2021] GET /compute/v2.1/servers/52d47b4c-e32e-4708-ade4-0be86b270c03 => generated 1314 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:36.289265 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-c0e1378b-e2c3-4cf6-a6cc-c966c11ff5ed tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:36.295292 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-5c179e7b-360a-4aa7-b647-99eff658c2f9 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:36.297847 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-c0e1378b-e2c3-4cf6-a6cc-c966c11ff5ed tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:36.299178 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-5c179e7b-360a-4aa7-b647-99eff658c2f9 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 8daa36f8-7d64-4d9d-94e6-0519848d4a2c] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:36.315167 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-5c179e7b-360a-4aa7-b647-99eff658c2f9 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:36.318964 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c0e1378b-e2c3-4cf6-a6cc-c966c11ff5ed tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:36.319537 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c0e1378b-e2c3-4cf6-a6cc-c966c11ff5ed tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:36.323369 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c0e1378b-e2c3-4cf6-a6cc-c966c11ff5ed tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:36.323766 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-5c179e7b-360a-4aa7-b647-99eff658c2f9 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:36.324976 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c0e1378b-e2c3-4cf6-a6cc-c966c11ff5ed tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:36.326263 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-5c179e7b-360a-4aa7-b647-99eff658c2f9 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:36.328795 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-5c179e7b-360a-4aa7-b647-99eff658c2f9 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:36.717679 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-5c179e7b-360a-4aa7-b647-99eff658c2f9 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:36.727290 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-5c179e7b-360a-4aa7-b647-99eff658c2f9 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c" status: 200 len: 1322 microversion: 2.1 time: 0.435368 Oct 29 01:29:36.728481 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 47/106] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:29:36 2021] GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c => generated 1322 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:29:36.746061 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-5cfcacc9-87ca-4146-9fae-fe43c1cfa6bc tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:36.746985 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-5cfcacc9-87ca-4146-9fae-fe43c1cfa6bc tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:36.773113 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-5cfcacc9-87ca-4146-9fae-fe43c1cfa6bc tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:36.778055 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-c0e1378b-e2c3-4cf6-a6cc-c966c11ff5ed tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:36.780571 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-5cfcacc9-87ca-4146-9fae-fe43c1cfa6bc tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:36.785362 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-5cfcacc9-87ca-4146-9fae-fe43c1cfa6bc tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:36.785825 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-5cfcacc9-87ca-4146-9fae-fe43c1cfa6bc tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:36.809840 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-c0e1378b-e2c3-4cf6-a6cc-c966c11ff5ed tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:36.812137 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-c0e1378b-e2c3-4cf6-a6cc-c966c11ff5ed tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:36.816952 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-c0e1378b-e2c3-4cf6-a6cc-c966c11ff5ed tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1406 microversion: 2.20 time: 0.530172 Oct 29 01:29:36.821373 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 60/107] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:29:36 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1406 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:29:36.844597 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-3f5babab-e196-41dc-af88-6c39555d416b tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:36.847242 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-3f5babab-e196-41dc-af88-6c39555d416b tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] [instance: 52d47b4c-e32e-4708-ade4-0be86b270c03] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:36.859525 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-3f5babab-e196-41dc-af88-6c39555d416b tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:36.860299 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-3f5babab-e196-41dc-af88-6c39555d416b tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:36.861870 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-3f5babab-e196-41dc-af88-6c39555d416b tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:36.862760 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-3f5babab-e196-41dc-af88-6c39555d416b tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:37.357249 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-5cfcacc9-87ca-4146-9fae-fe43c1cfa6bc tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045dda1ff9b44334954c08e63fcd20c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51a2093a0874d52a08f6e25489ba181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:37.366015 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-5cfcacc9-87ca-4146-9fae-fe43c1cfa6bc tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92" status: 200 len: 1364 microversion: 2.1 time: 0.624641 Oct 29 01:29:37.366697 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 48/108] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:29:36 2021] GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92 => generated 1364 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:37.371006 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [req-c4223277-390e-4209-af2a-26b0eb12b946 req-d08a69af-2c03-4de5-804b-3d54fef9bac3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f64f5ebf-8af1-4507-849e-b7d8e33979ae", "tag": "01153800-bf44-4376-854e-aec24743a4d7"}]} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:29:37.382968 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:29:37.382968 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: warnings.warn(msg) Oct 29 01:29:37.398825 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [req-c4223277-390e-4209-af2a-26b0eb12b946 req-d08a69af-2c03-4de5-804b-3d54fef9bac3 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:37.399267 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [req-c4223277-390e-4209-af2a-26b0eb12b946 req-d08a69af-2c03-4de5-804b-3d54fef9bac3 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:37.431475 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.compute.server_external_events [req-c4223277-390e-4209-af2a-26b0eb12b946 req-d08a69af-2c03-4de5-804b-3d54fef9bac3 service nova] Creating event network-changed:01153800-bf44-4376-854e-aec24743a4d7 for instance f64f5ebf-8af1-4507-849e-b7d8e33979ae on hv-cinder-81398 Oct 29 01:29:37.437371 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [req-c4223277-390e-4209-af2a-26b0eb12b946 req-d08a69af-2c03-4de5-804b-3d54fef9bac3 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069577 Oct 29 01:29:37.438615 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 49/109] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Oct 29 01:29:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:29:37.485040 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-3f5babab-e196-41dc-af88-6c39555d416b tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df16eb9ac1b7472ebe95d3739604e27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1a96bc2154de787f2d217b2ac27f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:37.496612 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-3f5babab-e196-41dc-af88-6c39555d416b tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] 10.222.0.87 "GET /compute/v2.1/servers/52d47b4c-e32e-4708-ade4-0be86b270c03" status: 200 len: 1314 microversion: 2.1 time: 0.673984 Oct 29 01:29:37.507161 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 61/110] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:29:36 2021] GET /compute/v2.1/servers/52d47b4c-e32e-4708-ade4-0be86b270c03 => generated 1314 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:37.757465 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-ba51ef08-a57e-40ee-916b-b9285d418362 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:37.758711 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-ba51ef08-a57e-40ee-916b-b9285d418362 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 8daa36f8-7d64-4d9d-94e6-0519848d4a2c] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:37.774558 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-ba51ef08-a57e-40ee-916b-b9285d418362 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:37.790634 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-ba51ef08-a57e-40ee-916b-b9285d418362 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:37.790634 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-ba51ef08-a57e-40ee-916b-b9285d418362 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:37.790634 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-ba51ef08-a57e-40ee-916b-b9285d418362 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:37.846578 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-d174059f-1ebf-4a61-9b6c-6410b3503a82 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:37.852896 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-d174059f-1ebf-4a61-9b6c-6410b3503a82 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:37.883354 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-d174059f-1ebf-4a61-9b6c-6410b3503a82 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:37.895970 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-d174059f-1ebf-4a61-9b6c-6410b3503a82 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:37.897318 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-d174059f-1ebf-4a61-9b6c-6410b3503a82 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:37.898082 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-d174059f-1ebf-4a61-9b6c-6410b3503a82 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:38.452056 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-d174059f-1ebf-4a61-9b6c-6410b3503a82 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:38.456446 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-ba51ef08-a57e-40ee-916b-b9285d418362 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:38.467802 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-d174059f-1ebf-4a61-9b6c-6410b3503a82 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:38.469821 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-d174059f-1ebf-4a61-9b6c-6410b3503a82 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:38.471764 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-d174059f-1ebf-4a61-9b6c-6410b3503a82 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1406 microversion: 2.20 time: 0.632801 Oct 29 01:29:38.472607 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 62/111] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:29:37 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1406 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:29:38.478445 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-9ef748dd-202d-489f-9a7e-1a530a7d9672 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:38.479410 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-9ef748dd-202d-489f-9a7e-1a530a7d9672 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:38.486241 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-9ef748dd-202d-489f-9a7e-1a530a7d9672 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:38.487715 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-9ef748dd-202d-489f-9a7e-1a530a7d9672 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:38.488816 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-9ef748dd-202d-489f-9a7e-1a530a7d9672 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:38.489476 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-9ef748dd-202d-489f-9a7e-1a530a7d9672 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:38.497659 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-ba51ef08-a57e-40ee-916b-b9285d418362 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c" status: 200 len: 1322 microversion: 2.1 time: 0.754899 Oct 29 01:29:38.502268 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 50/112] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:29:37 2021] GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c => generated 1322 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:38.528698 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-94b8dccb-8eda-4857-9597-2cff2f067534 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:38.528698 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-94b8dccb-8eda-4857-9597-2cff2f067534 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] [instance: 52d47b4c-e32e-4708-ade4-0be86b270c03] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:38.542367 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-94b8dccb-8eda-4857-9597-2cff2f067534 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:38.543251 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-94b8dccb-8eda-4857-9597-2cff2f067534 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:38.547032 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-94b8dccb-8eda-4857-9597-2cff2f067534 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:38.547032 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-94b8dccb-8eda-4857-9597-2cff2f067534 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:38.978589 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-94b8dccb-8eda-4857-9597-2cff2f067534 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df16eb9ac1b7472ebe95d3739604e27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1a96bc2154de787f2d217b2ac27f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:38.985874 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-94b8dccb-8eda-4857-9597-2cff2f067534 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] 10.222.0.87 "GET /compute/v2.1/servers/52d47b4c-e32e-4708-ade4-0be86b270c03" status: 200 len: 1314 microversion: 2.1 time: 0.474519 Oct 29 01:29:38.987453 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 51/113] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:29:38 2021] GET /compute/v2.1/servers/52d47b4c-e32e-4708-ade4-0be86b270c03 => generated 1314 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:39.004184 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-9ef748dd-202d-489f-9a7e-1a530a7d9672 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045dda1ff9b44334954c08e63fcd20c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51a2093a0874d52a08f6e25489ba181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:39.014047 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-9ef748dd-202d-489f-9a7e-1a530a7d9672 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92" status: 200 len: 1364 microversion: 2.1 time: 0.540020 Oct 29 01:29:39.014680 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 63/114] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:29:38 2021] GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92 => generated 1364 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:39.476496 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [req-272c00e7-49ff-4fa0-9e23-d455c81e2711 req-9b6960e0-3787-4dd9-a633-c5ee51b66de6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cc2f3ec-53ba-4b8c-a02a-236f8564eb92", "tag": "d40854b4-c7cf-4c79-ba60-0ea2a73669e5"}]} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:29:39.479426 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:29:39.479426 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: warnings.warn(msg) Oct 29 01:29:39.490368 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [req-272c00e7-49ff-4fa0-9e23-d455c81e2711 req-9b6960e0-3787-4dd9-a633-c5ee51b66de6 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:39.491168 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [req-272c00e7-49ff-4fa0-9e23-d455c81e2711 req-9b6960e0-3787-4dd9-a633-c5ee51b66de6 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:39.492067 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-0d451227-f84c-4d73-adc6-85b6ffcf1362 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:39.493715 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-0d451227-f84c-4d73-adc6-85b6ffcf1362 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:39.500007 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-0d451227-f84c-4d73-adc6-85b6ffcf1362 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:39.500710 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-0d451227-f84c-4d73-adc6-85b6ffcf1362 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:39.505772 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-0d451227-f84c-4d73-adc6-85b6ffcf1362 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:39.505772 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-0d451227-f84c-4d73-adc6-85b6ffcf1362 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:39.505973 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.compute.server_external_events [req-272c00e7-49ff-4fa0-9e23-d455c81e2711 req-9b6960e0-3787-4dd9-a633-c5ee51b66de6 service nova] Creating event network-changed:d40854b4-c7cf-4c79-ba60-0ea2a73669e5 for instance 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92 on hv-cinder-81398 Oct 29 01:29:39.513237 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [req-272c00e7-49ff-4fa0-9e23-d455c81e2711 req-9b6960e0-3787-4dd9-a633-c5ee51b66de6 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041318 Oct 29 01:29:39.513939 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 52/115] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Oct 29 01:29:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:29:39.519954 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-1bb5d0b0-0367-41cb-9643-ad17c450b619 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:39.521397 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-1bb5d0b0-0367-41cb-9643-ad17c450b619 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 8daa36f8-7d64-4d9d-94e6-0519848d4a2c] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:39.528668 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-1bb5d0b0-0367-41cb-9643-ad17c450b619 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:39.529140 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-1bb5d0b0-0367-41cb-9643-ad17c450b619 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:39.529978 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-1bb5d0b0-0367-41cb-9643-ad17c450b619 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:39.530415 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-1bb5d0b0-0367-41cb-9643-ad17c450b619 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:39.803447 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-0d451227-f84c-4d73-adc6-85b6ffcf1362 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:39.808702 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-1bb5d0b0-0367-41cb-9643-ad17c450b619 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:39.811124 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-0d451227-f84c-4d73-adc6-85b6ffcf1362 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:39.812691 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-0d451227-f84c-4d73-adc6-85b6ffcf1362 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:39.814297 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-0d451227-f84c-4d73-adc6-85b6ffcf1362 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1406 microversion: 2.20 time: 0.327918 Oct 29 01:29:39.815333 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 64/116] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:29:39 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1406 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:29:39.818054 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-1bb5d0b0-0367-41cb-9643-ad17c450b619 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c" status: 200 len: 1322 microversion: 2.1 time: 0.302904 Oct 29 01:29:39.827773 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 53/117] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:29:39 2021] GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c => generated 1322 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:40.005139 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-5e07cf97-86df-43c4-a87b-7a7cbb346103 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:40.005753 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-5e07cf97-86df-43c4-a87b-7a7cbb346103 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] [instance: 52d47b4c-e32e-4708-ade4-0be86b270c03] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:40.028786 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-5e07cf97-86df-43c4-a87b-7a7cbb346103 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:40.033315 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-5e07cf97-86df-43c4-a87b-7a7cbb346103 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:40.034086 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-6b4afa13-f30d-4843-ab5f-42e4131a3a39 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:40.036227 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-6b4afa13-f30d-4843-ab5f-42e4131a3a39 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:40.037198 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-5e07cf97-86df-43c4-a87b-7a7cbb346103 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:40.038803 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-5e07cf97-86df-43c4-a87b-7a7cbb346103 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:40.047502 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-6b4afa13-f30d-4843-ab5f-42e4131a3a39 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:40.058257 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-6b4afa13-f30d-4843-ab5f-42e4131a3a39 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:40.060316 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-6b4afa13-f30d-4843-ab5f-42e4131a3a39 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:40.062747 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-6b4afa13-f30d-4843-ab5f-42e4131a3a39 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:40.325507 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-5e07cf97-86df-43c4-a87b-7a7cbb346103 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df16eb9ac1b7472ebe95d3739604e27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1a96bc2154de787f2d217b2ac27f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:40.334984 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-5e07cf97-86df-43c4-a87b-7a7cbb346103 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] 10.222.0.87 "GET /compute/v2.1/servers/52d47b4c-e32e-4708-ade4-0be86b270c03" status: 200 len: 1314 microversion: 2.1 time: 0.334844 Oct 29 01:29:40.336085 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 65/118] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:29:39 2021] GET /compute/v2.1/servers/52d47b4c-e32e-4708-ade4-0be86b270c03 => generated 1314 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:40.370086 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-6b4afa13-f30d-4843-ab5f-42e4131a3a39 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045dda1ff9b44334954c08e63fcd20c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51a2093a0874d52a08f6e25489ba181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:40.379196 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-6b4afa13-f30d-4843-ab5f-42e4131a3a39 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92" status: 200 len: 1364 microversion: 2.1 time: 0.350740 Oct 29 01:29:40.379801 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 54/119] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:29:40 2021] GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92 => generated 1364 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:40.834362 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-6bf722ab-1f47-42e0-948f-29482c343f82 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:40.836321 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-45a7487e-541c-47e4-addf-ca3478fed391 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:40.838140 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-45a7487e-541c-47e4-addf-ca3478fed391 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:40.843994 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-6bf722ab-1f47-42e0-948f-29482c343f82 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 8daa36f8-7d64-4d9d-94e6-0519848d4a2c] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:40.850870 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-45a7487e-541c-47e4-addf-ca3478fed391 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:40.851040 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-6bf722ab-1f47-42e0-948f-29482c343f82 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:40.851714 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-6bf722ab-1f47-42e0-948f-29482c343f82 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:40.852656 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-6bf722ab-1f47-42e0-948f-29482c343f82 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:40.853152 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-6bf722ab-1f47-42e0-948f-29482c343f82 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:40.862411 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-45a7487e-541c-47e4-addf-ca3478fed391 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:40.863271 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-45a7487e-541c-47e4-addf-ca3478fed391 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:40.863714 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-45a7487e-541c-47e4-addf-ca3478fed391 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:41.072462 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-6bf722ab-1f47-42e0-948f-29482c343f82 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:41.080347 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-6bf722ab-1f47-42e0-948f-29482c343f82 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c" status: 200 len: 1322 microversion: 2.1 time: 0.249311 Oct 29 01:29:41.093408 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 55/120] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:29:40 2021] GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c => generated 1322 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:29:41.123541 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-45a7487e-541c-47e4-addf-ca3478fed391 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:41.135367 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-45a7487e-541c-47e4-addf-ca3478fed391 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:41.136898 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-45a7487e-541c-47e4-addf-ca3478fed391 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:41.138196 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-45a7487e-541c-47e4-addf-ca3478fed391 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1406 microversion: 2.20 time: 0.307337 Oct 29 01:29:41.138965 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 66/121] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:29:40 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1406 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:29:41.176769 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [req-a6cc40da-065e-48cf-8213-cbad1a85d89d req-12834912-a6de-4af2-b916-1b355e0e2550 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09875e40-e63d-4175-9361-fd9439c0c7ca", "name": "network-vif-plugged", "status": "completed", "tag": "ccaf14e9-30a4-4d96-9861-9c9c8b5e2172"}]} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:29:41.178365 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:29:41.178365 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: warnings.warn(msg) Oct 29 01:29:41.185305 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [req-a6cc40da-065e-48cf-8213-cbad1a85d89d req-12834912-a6de-4af2-b916-1b355e0e2550 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:41.185829 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [req-a6cc40da-065e-48cf-8213-cbad1a85d89d req-12834912-a6de-4af2-b916-1b355e0e2550 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:41.199984 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.compute.server_external_events [req-a6cc40da-065e-48cf-8213-cbad1a85d89d req-12834912-a6de-4af2-b916-1b355e0e2550 service nova] Creating event network-vif-plugged:ccaf14e9-30a4-4d96-9861-9c9c8b5e2172 for instance 09875e40-e63d-4175-9361-fd9439c0c7ca on hv-cinder-81398 Oct 29 01:29:41.207369 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [req-a6cc40da-065e-48cf-8213-cbad1a85d89d req-12834912-a6de-4af2-b916-1b355e0e2550 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112040 Oct 29 01:29:41.208941 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 56/122] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Oct 29 01:29:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:29:41.352047 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-f8022fea-7bef-4544-8676-d7badbb3d9f9 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:41.352736 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-f8022fea-7bef-4544-8676-d7badbb3d9f9 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] [instance: 52d47b4c-e32e-4708-ade4-0be86b270c03] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:41.358900 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-f8022fea-7bef-4544-8676-d7badbb3d9f9 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:41.359417 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-f8022fea-7bef-4544-8676-d7badbb3d9f9 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:41.360296 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-f8022fea-7bef-4544-8676-d7badbb3d9f9 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:41.360898 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-f8022fea-7bef-4544-8676-d7badbb3d9f9 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:41.405907 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-7cb6af1b-44b0-4147-8984-2e674b7ddfcc tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:41.406811 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-7cb6af1b-44b0-4147-8984-2e674b7ddfcc tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:41.424943 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-7cb6af1b-44b0-4147-8984-2e674b7ddfcc tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:41.425403 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-7cb6af1b-44b0-4147-8984-2e674b7ddfcc tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:41.426211 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-7cb6af1b-44b0-4147-8984-2e674b7ddfcc tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:41.426644 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-7cb6af1b-44b0-4147-8984-2e674b7ddfcc tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:41.733088 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-f8022fea-7bef-4544-8676-d7badbb3d9f9 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df16eb9ac1b7472ebe95d3739604e27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1a96bc2154de787f2d217b2ac27f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:41.745357 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-f8022fea-7bef-4544-8676-d7badbb3d9f9 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] 10.222.0.87 "GET /compute/v2.1/servers/52d47b4c-e32e-4708-ade4-0be86b270c03" status: 200 len: 1314 microversion: 2.1 time: 0.397008 Oct 29 01:29:41.746024 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 67/123] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:29:41 2021] GET /compute/v2.1/servers/52d47b4c-e32e-4708-ade4-0be86b270c03 => generated 1314 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:41.891153 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-7cb6af1b-44b0-4147-8984-2e674b7ddfcc tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045dda1ff9b44334954c08e63fcd20c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51a2093a0874d52a08f6e25489ba181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:41.906728 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-7cb6af1b-44b0-4147-8984-2e674b7ddfcc tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92" status: 200 len: 1364 microversion: 2.1 time: 0.513924 Oct 29 01:29:41.908667 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 57/124] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:29:41 2021] GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92 => generated 1364 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:42.100221 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-2a6a9513-7aac-40ae-abc2-21f5c224c655 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:42.101563 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-2a6a9513-7aac-40ae-abc2-21f5c224c655 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 8daa36f8-7d64-4d9d-94e6-0519848d4a2c] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:42.111942 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-2a6a9513-7aac-40ae-abc2-21f5c224c655 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:42.111942 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-2a6a9513-7aac-40ae-abc2-21f5c224c655 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:42.111942 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-2a6a9513-7aac-40ae-abc2-21f5c224c655 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:42.111942 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-2a6a9513-7aac-40ae-abc2-21f5c224c655 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:42.166945 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-5727813c-e735-4fc3-a388-ff25fc5ce720 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:42.167965 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-5727813c-e735-4fc3-a388-ff25fc5ce720 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:42.175275 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-5727813c-e735-4fc3-a388-ff25fc5ce720 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:42.175856 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-5727813c-e735-4fc3-a388-ff25fc5ce720 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:42.176720 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-5727813c-e735-4fc3-a388-ff25fc5ce720 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:42.177213 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-5727813c-e735-4fc3-a388-ff25fc5ce720 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:42.324287 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-2a6a9513-7aac-40ae-abc2-21f5c224c655 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:42.333216 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-2a6a9513-7aac-40ae-abc2-21f5c224c655 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c" status: 200 len: 1322 microversion: 2.1 time: 0.236712 Oct 29 01:29:42.333793 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 68/125] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:29:42 2021] GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c => generated 1322 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:42.430370 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-5727813c-e735-4fc3-a388-ff25fc5ce720 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:42.441851 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-5727813c-e735-4fc3-a388-ff25fc5ce720 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:42.444098 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-5727813c-e735-4fc3-a388-ff25fc5ce720 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:42.446036 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-5727813c-e735-4fc3-a388-ff25fc5ce720 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1406 microversion: 2.20 time: 0.284935 Oct 29 01:29:42.461378 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 58/126] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:29:42 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1406 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:29:42.763082 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-31313354-d842-41c8-9e9d-e88f7ac75ecd tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:42.763682 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-31313354-d842-41c8-9e9d-e88f7ac75ecd tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] [instance: 52d47b4c-e32e-4708-ade4-0be86b270c03] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:42.769982 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-31313354-d842-41c8-9e9d-e88f7ac75ecd tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:42.770502 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-31313354-d842-41c8-9e9d-e88f7ac75ecd tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:42.771194 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-31313354-d842-41c8-9e9d-e88f7ac75ecd tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:42.771623 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-31313354-d842-41c8-9e9d-e88f7ac75ecd tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:42.923844 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-31313354-d842-41c8-9e9d-e88f7ac75ecd tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df16eb9ac1b7472ebe95d3739604e27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1a96bc2154de787f2d217b2ac27f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:42.925819 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-a6cf1f6f-aeb3-43e9-96e3-3a942c83c1b8 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:42.926432 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-a6cf1f6f-aeb3-43e9-96e3-3a942c83c1b8 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:42.929362 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-31313354-d842-41c8-9e9d-e88f7ac75ecd tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] 10.222.0.87 "GET /compute/v2.1/servers/52d47b4c-e32e-4708-ade4-0be86b270c03" status: 200 len: 1314 microversion: 2.1 time: 0.169894 Oct 29 01:29:42.929933 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 69/127] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:29:42 2021] GET /compute/v2.1/servers/52d47b4c-e32e-4708-ade4-0be86b270c03 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:42.932287 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-a6cf1f6f-aeb3-43e9-96e3-3a942c83c1b8 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:42.932741 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-a6cf1f6f-aeb3-43e9-96e3-3a942c83c1b8 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:42.933520 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-a6cf1f6f-aeb3-43e9-96e3-3a942c83c1b8 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:42.934007 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-a6cf1f6f-aeb3-43e9-96e3-3a942c83c1b8 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:43.084672 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-a6cf1f6f-aeb3-43e9-96e3-3a942c83c1b8 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045dda1ff9b44334954c08e63fcd20c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51a2093a0874d52a08f6e25489ba181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:43.092202 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-a6cf1f6f-aeb3-43e9-96e3-3a942c83c1b8 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92" status: 200 len: 1364 microversion: 2.1 time: 0.170558 Oct 29 01:29:43.092999 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 59/128] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:29:42 2021] GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92 => generated 1364 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:43.239794 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [req-d0b68efc-5351-4d3b-8ebf-32c4d34f52df req-cee535de-eea7-40a1-ad77-61f0d8f8a07c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8daa36f8-7d64-4d9d-94e6-0519848d4a2c", "name": "network-vif-plugged", "status": "completed", "tag": "8795097b-0746-4ca7-81ba-d053d48c81c2"}, {"server_uuid": "52d47b4c-e32e-4708-ade4-0be86b270c03", "name": "network-vif-plugged", "status": "completed", "tag": "7c7389c9-c004-43ca-b348-25bb91613962"}]} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:29:43.243170 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:29:43.243170 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: warnings.warn(msg) Oct 29 01:29:43.257308 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [req-d0b68efc-5351-4d3b-8ebf-32c4d34f52df req-cee535de-eea7-40a1-ad77-61f0d8f8a07c service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:43.258021 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [req-d0b68efc-5351-4d3b-8ebf-32c4d34f52df req-cee535de-eea7-40a1-ad77-61f0d8f8a07c service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:43.281425 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.compute.server_external_events [req-d0b68efc-5351-4d3b-8ebf-32c4d34f52df req-cee535de-eea7-40a1-ad77-61f0d8f8a07c service nova] Creating event network-vif-plugged:8795097b-0746-4ca7-81ba-d053d48c81c2 for instance 8daa36f8-7d64-4d9d-94e6-0519848d4a2c on hv-cinder-81398 Oct 29 01:29:43.282191 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.compute.server_external_events [req-d0b68efc-5351-4d3b-8ebf-32c4d34f52df req-cee535de-eea7-40a1-ad77-61f0d8f8a07c service nova] Creating event network-vif-plugged:7c7389c9-c004-43ca-b348-25bb91613962 for instance 52d47b4c-e32e-4708-ade4-0be86b270c03 on hv-cinder-81398 Oct 29 01:29:43.289963 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [req-d0b68efc-5351-4d3b-8ebf-32c4d34f52df req-cee535de-eea7-40a1-ad77-61f0d8f8a07c service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.057285 Oct 29 01:29:43.290564 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 70/129] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Oct 29 01:29:43 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:29:43.349834 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-d42c85e3-ddcc-4ad3-ad60-73df1370dbf5 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:43.350478 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-d42c85e3-ddcc-4ad3-ad60-73df1370dbf5 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 8daa36f8-7d64-4d9d-94e6-0519848d4a2c] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:43.366024 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d42c85e3-ddcc-4ad3-ad60-73df1370dbf5 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:43.369384 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d42c85e3-ddcc-4ad3-ad60-73df1370dbf5 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:43.369384 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d42c85e3-ddcc-4ad3-ad60-73df1370dbf5 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:43.369384 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d42c85e3-ddcc-4ad3-ad60-73df1370dbf5 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:43.469003 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-51cec69f-5201-4cbf-846d-efafe997490e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:43.470042 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-51cec69f-5201-4cbf-846d-efafe997490e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:43.479050 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-51cec69f-5201-4cbf-846d-efafe997490e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:43.479783 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-51cec69f-5201-4cbf-846d-efafe997490e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:43.487891 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-51cec69f-5201-4cbf-846d-efafe997490e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:43.487891 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-51cec69f-5201-4cbf-846d-efafe997490e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:43.539767 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-d42c85e3-ddcc-4ad3-ad60-73df1370dbf5 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:43.550310 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-d42c85e3-ddcc-4ad3-ad60-73df1370dbf5 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c" status: 200 len: 1322 microversion: 2.1 time: 0.202033 Oct 29 01:29:43.562022 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 60/130] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:29:43 2021] GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c => generated 1322 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:43.692996 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-51cec69f-5201-4cbf-846d-efafe997490e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:43.706795 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-51cec69f-5201-4cbf-846d-efafe997490e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:43.711802 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-51cec69f-5201-4cbf-846d-efafe997490e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:43.713172 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-51cec69f-5201-4cbf-846d-efafe997490e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1406 microversion: 2.20 time: 0.249155 Oct 29 01:29:43.713736 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 71/131] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:29:43 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1406 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:29:43.947073 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-308ea707-7a50-40ad-8c89-847280cf361b tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:43.948553 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-308ea707-7a50-40ad-8c89-847280cf361b tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] [instance: 52d47b4c-e32e-4708-ade4-0be86b270c03] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:43.959378 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-308ea707-7a50-40ad-8c89-847280cf361b tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:43.959859 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-308ea707-7a50-40ad-8c89-847280cf361b tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:43.960642 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-308ea707-7a50-40ad-8c89-847280cf361b tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:43.965968 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-308ea707-7a50-40ad-8c89-847280cf361b tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:44.111594 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-4a8530da-8e85-4962-a48e-f9fca6c8b508 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:44.112742 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-4a8530da-8e85-4962-a48e-f9fca6c8b508 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:44.118852 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4a8530da-8e85-4962-a48e-f9fca6c8b508 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:44.119447 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4a8530da-8e85-4962-a48e-f9fca6c8b508 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:44.120484 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4a8530da-8e85-4962-a48e-f9fca6c8b508 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:44.121066 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4a8530da-8e85-4962-a48e-f9fca6c8b508 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:44.294467 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-308ea707-7a50-40ad-8c89-847280cf361b tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df16eb9ac1b7472ebe95d3739604e27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1a96bc2154de787f2d217b2ac27f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:44.306018 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-308ea707-7a50-40ad-8c89-847280cf361b tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] 10.222.0.87 "GET /compute/v2.1/servers/52d47b4c-e32e-4708-ade4-0be86b270c03" status: 200 len: 1314 microversion: 2.1 time: 0.364229 Oct 29 01:29:44.307095 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 61/132] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:29:43 2021] GET /compute/v2.1/servers/52d47b4c-e32e-4708-ade4-0be86b270c03 => generated 1314 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:44.379658 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-4a8530da-8e85-4962-a48e-f9fca6c8b508 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045dda1ff9b44334954c08e63fcd20c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51a2093a0874d52a08f6e25489ba181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:44.387213 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-4a8530da-8e85-4962-a48e-f9fca6c8b508 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92" status: 200 len: 1364 microversion: 2.1 time: 0.281133 Oct 29 01:29:44.388797 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 72/133] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:29:44 2021] GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92 => generated 1364 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:29:44.566524 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-34d02067-ef46-4b87-942d-0de7126471a1 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:44.567037 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-34d02067-ef46-4b87-942d-0de7126471a1 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 8daa36f8-7d64-4d9d-94e6-0519848d4a2c] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:44.572958 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-34d02067-ef46-4b87-942d-0de7126471a1 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:44.573390 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-34d02067-ef46-4b87-942d-0de7126471a1 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:44.574165 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-34d02067-ef46-4b87-942d-0de7126471a1 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:44.574841 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-34d02067-ef46-4b87-942d-0de7126471a1 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:44.729431 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-34d02067-ef46-4b87-942d-0de7126471a1 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:44.733187 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-4c5c48b3-98d5-4d00-9afb-1ddc0a679fa1 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:44.734142 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-4c5c48b3-98d5-4d00-9afb-1ddc0a679fa1 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:44.741157 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-34d02067-ef46-4b87-942d-0de7126471a1 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c" status: 200 len: 1322 microversion: 2.1 time: 0.178254 Oct 29 01:29:44.741892 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 62/134] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:29:44 2021] GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c => generated 1322 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:44.743589 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4c5c48b3-98d5-4d00-9afb-1ddc0a679fa1 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:44.744308 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4c5c48b3-98d5-4d00-9afb-1ddc0a679fa1 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:44.745316 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4c5c48b3-98d5-4d00-9afb-1ddc0a679fa1 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:44.745950 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4c5c48b3-98d5-4d00-9afb-1ddc0a679fa1 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:44.931316 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-4c5c48b3-98d5-4d00-9afb-1ddc0a679fa1 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:44.942275 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-4c5c48b3-98d5-4d00-9afb-1ddc0a679fa1 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:44.943819 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-4c5c48b3-98d5-4d00-9afb-1ddc0a679fa1 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:44.944948 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-4c5c48b3-98d5-4d00-9afb-1ddc0a679fa1 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1406 microversion: 2.20 time: 0.216343 Oct 29 01:29:44.945657 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 73/135] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:29:44 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1406 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:29:45.306451 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [req-45485544-0f9e-42d5-9cbe-960c733a456f req-ddcc1ec1-1e72-4d48-a72d-9e7e5c221a4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f64f5ebf-8af1-4507-849e-b7d8e33979ae", "name": "network-vif-plugged", "status": "completed", "tag": "01153800-bf44-4376-854e-aec24743a4d7"}]} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:29:45.308314 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:29:45.308314 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: warnings.warn(msg) Oct 29 01:29:45.323780 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [req-45485544-0f9e-42d5-9cbe-960c733a456f req-ddcc1ec1-1e72-4d48-a72d-9e7e5c221a4c service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:45.323780 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [req-45485544-0f9e-42d5-9cbe-960c733a456f req-ddcc1ec1-1e72-4d48-a72d-9e7e5c221a4c service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:45.324178 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-8551defa-8eb2-4d65-92ea-7e3867d2d1c4 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:45.324801 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-8551defa-8eb2-4d65-92ea-7e3867d2d1c4 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] [instance: 52d47b4c-e32e-4708-ade4-0be86b270c03] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:45.331312 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-8551defa-8eb2-4d65-92ea-7e3867d2d1c4 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:45.331783 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-8551defa-8eb2-4d65-92ea-7e3867d2d1c4 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:45.331911 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.compute.server_external_events [req-45485544-0f9e-42d5-9cbe-960c733a456f req-ddcc1ec1-1e72-4d48-a72d-9e7e5c221a4c service nova] Creating event network-vif-plugged:01153800-bf44-4376-854e-aec24743a4d7 for instance f64f5ebf-8af1-4507-849e-b7d8e33979ae on hv-cinder-81398 Oct 29 01:29:45.332562 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-8551defa-8eb2-4d65-92ea-7e3867d2d1c4 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:45.335759 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-8551defa-8eb2-4d65-92ea-7e3867d2d1c4 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:45.346252 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [req-45485544-0f9e-42d5-9cbe-960c733a456f req-ddcc1ec1-1e72-4d48-a72d-9e7e5c221a4c service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043145 Oct 29 01:29:45.347205 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 63/136] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Oct 29 01:29:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:29:45.409160 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-63f4bb1e-7bd3-428d-a389-1a15397ba539 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:45.410230 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-63f4bb1e-7bd3-428d-a389-1a15397ba539 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:45.417476 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-63f4bb1e-7bd3-428d-a389-1a15397ba539 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:45.418279 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-63f4bb1e-7bd3-428d-a389-1a15397ba539 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:45.419262 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-63f4bb1e-7bd3-428d-a389-1a15397ba539 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:45.419902 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-63f4bb1e-7bd3-428d-a389-1a15397ba539 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:45.513447 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-8551defa-8eb2-4d65-92ea-7e3867d2d1c4 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df16eb9ac1b7472ebe95d3739604e27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1a96bc2154de787f2d217b2ac27f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:45.537527 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-8551defa-8eb2-4d65-92ea-7e3867d2d1c4 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] 10.222.0.87 "GET /compute/v2.1/servers/52d47b4c-e32e-4708-ade4-0be86b270c03" status: 200 len: 1314 microversion: 2.1 time: 0.203747 Oct 29 01:29:45.537527 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 74/137] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:29:45 2021] GET /compute/v2.1/servers/52d47b4c-e32e-4708-ade4-0be86b270c03 => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:29:45.570505 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-63f4bb1e-7bd3-428d-a389-1a15397ba539 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045dda1ff9b44334954c08e63fcd20c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51a2093a0874d52a08f6e25489ba181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:45.578026 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-63f4bb1e-7bd3-428d-a389-1a15397ba539 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92" status: 200 len: 1364 microversion: 2.1 time: 0.176829 Oct 29 01:29:45.578563 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 64/138] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:29:45 2021] GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92 => generated 1364 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:29:45.758145 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-353476d3-b3df-4cad-ba02-cc514e195fc1 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:45.758872 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-353476d3-b3df-4cad-ba02-cc514e195fc1 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 8daa36f8-7d64-4d9d-94e6-0519848d4a2c] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:45.765561 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-353476d3-b3df-4cad-ba02-cc514e195fc1 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:45.766075 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-353476d3-b3df-4cad-ba02-cc514e195fc1 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:45.767655 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-353476d3-b3df-4cad-ba02-cc514e195fc1 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:45.768330 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-353476d3-b3df-4cad-ba02-cc514e195fc1 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:45.906311 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-353476d3-b3df-4cad-ba02-cc514e195fc1 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:45.914832 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-353476d3-b3df-4cad-ba02-cc514e195fc1 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c" status: 200 len: 1515 microversion: 2.1 time: 0.160385 Oct 29 01:29:45.915713 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 75/139] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:29:45 2021] GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c => generated 1515 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:45.932838 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-b257c5db-c09d-4c03-af17-f6b0ae2be399 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:29:45.933807 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-b257c5db-c09d-4c03-af17-f6b0ae2be399 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 8daa36f8-7d64-4d9d-94e6-0519848d4a2c] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:45.939987 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-b257c5db-c09d-4c03-af17-f6b0ae2be399 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:45.940429 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-b257c5db-c09d-4c03-af17-f6b0ae2be399 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:45.941428 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-b257c5db-c09d-4c03-af17-f6b0ae2be399 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:45.941855 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-b257c5db-c09d-4c03-af17-f6b0ae2be399 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:45.964665 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-a4bffbca-52f1-41a4-a457-290c33b6a1d8 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:45.965464 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-a4bffbca-52f1-41a4-a457-290c33b6a1d8 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:45.973077 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a4bffbca-52f1-41a4-a457-290c33b6a1d8 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:45.974328 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a4bffbca-52f1-41a4-a457-290c33b6a1d8 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:45.974799 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a4bffbca-52f1-41a4-a457-290c33b6a1d8 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:45.975548 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a4bffbca-52f1-41a4-a457-290c33b6a1d8 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:46.016051 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.objects.instance [None req-b257c5db-c09d-4c03-af17-f6b0ae2be399 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lazy-loading 'flavor' on Instance uuid 8daa36f8-7d64-4d9d-94e6-0519848d4a2c {{(pid=116379) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 01:29:46.116265 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-a4bffbca-52f1-41a4-a457-290c33b6a1d8 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:46.124282 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-a4bffbca-52f1-41a4-a457-290c33b6a1d8 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:46.125929 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-a4bffbca-52f1-41a4-a457-290c33b6a1d8 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:46.127286 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-a4bffbca-52f1-41a4-a457-290c33b6a1d8 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1406 microversion: 2.20 time: 0.166759 Oct 29 01:29:46.128005 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 76/140] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:29:45 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:29:46.462119 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-b257c5db-c09d-4c03-af17-f6b0ae2be399 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "POST /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c/action" status: 200 len: 32 microversion: 2.1 time: 0.533013 Oct 29 01:29:46.462867 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 65/141] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:29:45 2021] POST /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c/action => generated 32 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:29:46.474105 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-caa3cf19-2cce-41c3-a9c7-39ba4b053a5a tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:46.474105 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-caa3cf19-2cce-41c3-a9c7-39ba4b053a5a tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 8daa36f8-7d64-4d9d-94e6-0519848d4a2c] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:46.479701 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-caa3cf19-2cce-41c3-a9c7-39ba4b053a5a tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:46.480164 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-caa3cf19-2cce-41c3-a9c7-39ba4b053a5a tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:46.481167 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-caa3cf19-2cce-41c3-a9c7-39ba4b053a5a tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:46.481592 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-caa3cf19-2cce-41c3-a9c7-39ba4b053a5a tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:46.555382 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-91adaabb-d4c7-4852-a756-38f9983e0182 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:46.556675 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-91adaabb-d4c7-4852-a756-38f9983e0182 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] [instance: 52d47b4c-e32e-4708-ade4-0be86b270c03] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:46.564939 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-91adaabb-d4c7-4852-a756-38f9983e0182 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:46.565250 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-91adaabb-d4c7-4852-a756-38f9983e0182 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:46.566034 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-91adaabb-d4c7-4852-a756-38f9983e0182 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:46.566564 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-91adaabb-d4c7-4852-a756-38f9983e0182 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:46.656826 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-caa3cf19-2cce-41c3-a9c7-39ba4b053a5a tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:46.666587 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-caa3cf19-2cce-41c3-a9c7-39ba4b053a5a tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c" status: 200 len: 1521 microversion: 2.1 time: 0.198535 Oct 29 01:29:46.668317 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 77/142] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:29:46 2021] GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:46.674337 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-5c2e2117-c100-4e03-96fe-8c71c8db89a2 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:46.677448 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-5c2e2117-c100-4e03-96fe-8c71c8db89a2 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:46.695071 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-5c2e2117-c100-4e03-96fe-8c71c8db89a2 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:46.696954 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-5c2e2117-c100-4e03-96fe-8c71c8db89a2 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:46.699058 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-5c2e2117-c100-4e03-96fe-8c71c8db89a2 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:46.700600 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-5c2e2117-c100-4e03-96fe-8c71c8db89a2 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:46.738286 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-91adaabb-d4c7-4852-a756-38f9983e0182 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df16eb9ac1b7472ebe95d3739604e27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1a96bc2154de787f2d217b2ac27f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:46.747630 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-91adaabb-d4c7-4852-a756-38f9983e0182 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] 10.222.0.87 "GET /compute/v2.1/servers/52d47b4c-e32e-4708-ade4-0be86b270c03" status: 200 len: 1314 microversion: 2.1 time: 0.198531 Oct 29 01:29:46.751892 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 66/143] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:29:46 2021] GET /compute/v2.1/servers/52d47b4c-e32e-4708-ade4-0be86b270c03 => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:46.854124 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-5c2e2117-c100-4e03-96fe-8c71c8db89a2 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045dda1ff9b44334954c08e63fcd20c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51a2093a0874d52a08f6e25489ba181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:46.861383 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-5c2e2117-c100-4e03-96fe-8c71c8db89a2 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92" status: 200 len: 1364 microversion: 2.1 time: 0.190378 Oct 29 01:29:46.861963 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 78/144] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:29:46 2021] GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92 => generated 1364 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:47.145068 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-4a944a7b-0d14-4b62-a435-89bc9385f424 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:47.145804 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-4a944a7b-0d14-4b62-a435-89bc9385f424 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:47.151760 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-4a944a7b-0d14-4b62-a435-89bc9385f424 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:47.158215 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-4a944a7b-0d14-4b62-a435-89bc9385f424 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:47.158215 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-4a944a7b-0d14-4b62-a435-89bc9385f424 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:47.158215 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-4a944a7b-0d14-4b62-a435-89bc9385f424 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:47.285147 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-4a944a7b-0d14-4b62-a435-89bc9385f424 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:47.293194 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-4a944a7b-0d14-4b62-a435-89bc9385f424 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:47.294674 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-4a944a7b-0d14-4b62-a435-89bc9385f424 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:47.295868 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-4a944a7b-0d14-4b62-a435-89bc9385f424 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1406 microversion: 2.20 time: 0.155027 Oct 29 01:29:47.296408 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 67/145] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:29:47 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:29:47.684471 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-7e0d950c-8f4c-43fe-aa9d-1f7a961251fe tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:47.685075 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-7e0d950c-8f4c-43fe-aa9d-1f7a961251fe tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 8daa36f8-7d64-4d9d-94e6-0519848d4a2c] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:47.691194 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-7e0d950c-8f4c-43fe-aa9d-1f7a961251fe tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:47.691638 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-7e0d950c-8f4c-43fe-aa9d-1f7a961251fe tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:47.692431 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-7e0d950c-8f4c-43fe-aa9d-1f7a961251fe tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:47.692904 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-7e0d950c-8f4c-43fe-aa9d-1f7a961251fe tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:47.769046 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-fec9a1fa-3806-408b-a0b0-b86a05aaa343 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:47.769659 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-fec9a1fa-3806-408b-a0b0-b86a05aaa343 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] [instance: 52d47b4c-e32e-4708-ade4-0be86b270c03] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:47.775834 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-fec9a1fa-3806-408b-a0b0-b86a05aaa343 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:47.776294 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-fec9a1fa-3806-408b-a0b0-b86a05aaa343 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:47.777126 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-fec9a1fa-3806-408b-a0b0-b86a05aaa343 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:47.777570 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-fec9a1fa-3806-408b-a0b0-b86a05aaa343 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:47.910805 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-7e0d950c-8f4c-43fe-aa9d-1f7a961251fe tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:47.933422 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-7e0d950c-8f4c-43fe-aa9d-1f7a961251fe tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c" status: 200 len: 1521 microversion: 2.1 time: 0.252166 Oct 29 01:29:47.948716 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 79/146] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:29:47 2021] GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c => generated 1521 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:47.960969 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-1b9c8cb4-4b4b-4e68-80f4-001effc31541 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:47.966297 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-1b9c8cb4-4b4b-4e68-80f4-001effc31541 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:47.978728 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-1b9c8cb4-4b4b-4e68-80f4-001effc31541 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:47.979675 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-1b9c8cb4-4b4b-4e68-80f4-001effc31541 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:47.982223 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-1b9c8cb4-4b4b-4e68-80f4-001effc31541 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:47.983111 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-1b9c8cb4-4b4b-4e68-80f4-001effc31541 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:47.992802 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-fec9a1fa-3806-408b-a0b0-b86a05aaa343 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df16eb9ac1b7472ebe95d3739604e27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1a96bc2154de787f2d217b2ac27f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:48.002487 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-fec9a1fa-3806-408b-a0b0-b86a05aaa343 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] 10.222.0.87 "GET /compute/v2.1/servers/52d47b4c-e32e-4708-ade4-0be86b270c03" status: 200 len: 1314 microversion: 2.1 time: 0.238380 Oct 29 01:29:48.003063 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 68/147] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:29:47 2021] GET /compute/v2.1/servers/52d47b4c-e32e-4708-ade4-0be86b270c03 => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:29:48.155060 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-1b9c8cb4-4b4b-4e68-80f4-001effc31541 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045dda1ff9b44334954c08e63fcd20c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51a2093a0874d52a08f6e25489ba181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:48.172352 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-1b9c8cb4-4b4b-4e68-80f4-001effc31541 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92" status: 200 len: 1364 microversion: 2.1 time: 0.222051 Oct 29 01:29:48.185622 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 80/148] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:29:47 2021] GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92 => generated 1364 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:48.324103 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-6fd00535-31bb-4d45-916e-0e5f72471ded tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:48.325365 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-6fd00535-31bb-4d45-916e-0e5f72471ded tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:48.340044 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-6fd00535-31bb-4d45-916e-0e5f72471ded tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:48.340773 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-6fd00535-31bb-4d45-916e-0e5f72471ded tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:48.341754 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-6fd00535-31bb-4d45-916e-0e5f72471ded tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:48.342173 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-6fd00535-31bb-4d45-916e-0e5f72471ded tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:48.485090 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-6fd00535-31bb-4d45-916e-0e5f72471ded tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:48.494529 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-6fd00535-31bb-4d45-916e-0e5f72471ded tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:48.496240 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-6fd00535-31bb-4d45-916e-0e5f72471ded tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:48.497411 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-6fd00535-31bb-4d45-916e-0e5f72471ded tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1406 microversion: 2.20 time: 0.177467 Oct 29 01:29:48.498064 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 69/149] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:29:48 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1406 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:29:48.950435 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-78901141-e324-4dd1-8dc2-7a744d302e96 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:48.951059 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-78901141-e324-4dd1-8dc2-7a744d302e96 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 8daa36f8-7d64-4d9d-94e6-0519848d4a2c] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:48.957739 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-78901141-e324-4dd1-8dc2-7a744d302e96 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:48.958112 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-78901141-e324-4dd1-8dc2-7a744d302e96 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:48.958873 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-78901141-e324-4dd1-8dc2-7a744d302e96 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:48.959314 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-78901141-e324-4dd1-8dc2-7a744d302e96 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:49.019914 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-4b60e8d4-ab82-4019-ac06-22eee060ff9a tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:49.020893 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-4b60e8d4-ab82-4019-ac06-22eee060ff9a tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] [instance: 52d47b4c-e32e-4708-ade4-0be86b270c03] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:49.026992 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-4b60e8d4-ab82-4019-ac06-22eee060ff9a tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:49.027823 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-4b60e8d4-ab82-4019-ac06-22eee060ff9a tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:49.029119 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-4b60e8d4-ab82-4019-ac06-22eee060ff9a tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:49.029703 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-4b60e8d4-ab82-4019-ac06-22eee060ff9a tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:49.192701 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-78901141-e324-4dd1-8dc2-7a744d302e96 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:49.200260 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-78901141-e324-4dd1-8dc2-7a744d302e96 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c" status: 200 len: 1521 microversion: 2.1 time: 0.253726 Oct 29 01:29:49.200841 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 81/150] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:29:48 2021] GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c => generated 1521 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:49.205127 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-43982368-365d-4597-b577-2ee4b648ca4d tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:49.205722 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-43982368-365d-4597-b577-2ee4b648ca4d tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:49.213546 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-43982368-365d-4597-b577-2ee4b648ca4d tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:49.214089 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-43982368-365d-4597-b577-2ee4b648ca4d tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:49.219658 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-43982368-365d-4597-b577-2ee4b648ca4d tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:49.219658 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-43982368-365d-4597-b577-2ee4b648ca4d tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:49.289615 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-4b60e8d4-ab82-4019-ac06-22eee060ff9a tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df16eb9ac1b7472ebe95d3739604e27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1a96bc2154de787f2d217b2ac27f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:49.297643 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-4b60e8d4-ab82-4019-ac06-22eee060ff9a tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] 10.222.0.87 "GET /compute/v2.1/servers/52d47b4c-e32e-4708-ade4-0be86b270c03" status: 200 len: 1500 microversion: 2.1 time: 0.281937 Oct 29 01:29:49.303495 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 70/151] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:29:49 2021] GET /compute/v2.1/servers/52d47b4c-e32e-4708-ade4-0be86b270c03 => generated 1500 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:49.353951 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-43982368-365d-4597-b577-2ee4b648ca4d tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045dda1ff9b44334954c08e63fcd20c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51a2093a0874d52a08f6e25489ba181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:49.361863 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-43982368-365d-4597-b577-2ee4b648ca4d tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92" status: 200 len: 1364 microversion: 2.1 time: 0.159949 Oct 29 01:29:49.362559 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 82/152] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:29:49 2021] GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:49.516321 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-c8df70a3-f8d6-45a3-bc1a-e7d1500e8d1e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:49.517596 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-c8df70a3-f8d6-45a3-bc1a-e7d1500e8d1e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:49.523800 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-c8df70a3-f8d6-45a3-bc1a-e7d1500e8d1e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:49.524242 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-c8df70a3-f8d6-45a3-bc1a-e7d1500e8d1e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:49.525011 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-c8df70a3-f8d6-45a3-bc1a-e7d1500e8d1e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:49.525430 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-c8df70a3-f8d6-45a3-bc1a-e7d1500e8d1e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:49.648576 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-c8df70a3-f8d6-45a3-bc1a-e7d1500e8d1e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:49.656632 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-c8df70a3-f8d6-45a3-bc1a-e7d1500e8d1e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:49.658313 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-c8df70a3-f8d6-45a3-bc1a-e7d1500e8d1e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:49.659412 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-c8df70a3-f8d6-45a3-bc1a-e7d1500e8d1e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1406 microversion: 2.20 time: 0.146923 Oct 29 01:29:49.664007 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 71/153] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:29:49 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1406 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:29:50.217107 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-3002e1c1-58a6-4dfe-ac77-a4b9a69fa010 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:50.217706 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-3002e1c1-58a6-4dfe-ac77-a4b9a69fa010 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 8daa36f8-7d64-4d9d-94e6-0519848d4a2c] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:50.223664 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-3002e1c1-58a6-4dfe-ac77-a4b9a69fa010 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:50.224137 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-3002e1c1-58a6-4dfe-ac77-a4b9a69fa010 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:50.224920 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-3002e1c1-58a6-4dfe-ac77-a4b9a69fa010 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:50.225336 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-3002e1c1-58a6-4dfe-ac77-a4b9a69fa010 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:50.354010 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-3002e1c1-58a6-4dfe-ac77-a4b9a69fa010 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:50.362219 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-3002e1c1-58a6-4dfe-ac77-a4b9a69fa010 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c" status: 200 len: 1521 microversion: 2.1 time: 0.148765 Oct 29 01:29:50.364498 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 83/154] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:29:50 2021] GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:50.378263 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-438b0bb9-2962-46fd-b14f-a01a6ab3294a tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:50.378930 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-438b0bb9-2962-46fd-b14f-a01a6ab3294a tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:50.384868 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-438b0bb9-2962-46fd-b14f-a01a6ab3294a tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:50.385382 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-438b0bb9-2962-46fd-b14f-a01a6ab3294a tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:50.386211 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-438b0bb9-2962-46fd-b14f-a01a6ab3294a tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:50.386704 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-438b0bb9-2962-46fd-b14f-a01a6ab3294a tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:50.512840 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-438b0bb9-2962-46fd-b14f-a01a6ab3294a tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045dda1ff9b44334954c08e63fcd20c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51a2093a0874d52a08f6e25489ba181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:50.520987 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-438b0bb9-2962-46fd-b14f-a01a6ab3294a tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92" status: 200 len: 1364 microversion: 2.1 time: 0.146646 Oct 29 01:29:50.521564 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 72/155] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:29:50 2021] GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92 => generated 1364 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:50.677868 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-76a11798-da1a-4a0c-ac26-2943a1006e44 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:50.678465 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-76a11798-da1a-4a0c-ac26-2943a1006e44 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:50.684374 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-76a11798-da1a-4a0c-ac26-2943a1006e44 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:50.684900 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-76a11798-da1a-4a0c-ac26-2943a1006e44 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:50.685735 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-76a11798-da1a-4a0c-ac26-2943a1006e44 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:50.686164 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-76a11798-da1a-4a0c-ac26-2943a1006e44 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:50.813502 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-76a11798-da1a-4a0c-ac26-2943a1006e44 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:50.822104 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-76a11798-da1a-4a0c-ac26-2943a1006e44 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:50.823601 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-76a11798-da1a-4a0c-ac26-2943a1006e44 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:50.824980 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-76a11798-da1a-4a0c-ac26-2943a1006e44 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1406 microversion: 2.20 time: 0.150599 Oct 29 01:29:50.825855 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 84/156] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:29:50 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:29:51.389297 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-f1aacc54-4fc3-4f8c-ae56-451c3f5247e8 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:51.390718 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-f1aacc54-4fc3-4f8c-ae56-451c3f5247e8 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 8daa36f8-7d64-4d9d-94e6-0519848d4a2c] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:51.398419 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-f1aacc54-4fc3-4f8c-ae56-451c3f5247e8 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:51.399179 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-f1aacc54-4fc3-4f8c-ae56-451c3f5247e8 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:51.400197 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-f1aacc54-4fc3-4f8c-ae56-451c3f5247e8 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:51.400830 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-f1aacc54-4fc3-4f8c-ae56-451c3f5247e8 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:51.476687 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [req-ccff1df1-7357-4205-a4ae-b74e376f9617 req-02682c23-4a8a-4a30-a874-b92496d1164b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cc2f3ec-53ba-4b8c-a02a-236f8564eb92", "name": "network-vif-plugged", "status": "completed", "tag": "d40854b4-c7cf-4c79-ba60-0ea2a73669e5"}]} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:29:51.480146 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:29:51.480146 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: warnings.warn(msg) Oct 29 01:29:51.490152 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [req-ccff1df1-7357-4205-a4ae-b74e376f9617 req-02682c23-4a8a-4a30-a874-b92496d1164b service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:51.490833 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [req-ccff1df1-7357-4205-a4ae-b74e376f9617 req-02682c23-4a8a-4a30-a874-b92496d1164b service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:51.505747 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.compute.server_external_events [req-ccff1df1-7357-4205-a4ae-b74e376f9617 req-02682c23-4a8a-4a30-a874-b92496d1164b service nova] Creating event network-vif-plugged:d40854b4-c7cf-4c79-ba60-0ea2a73669e5 for instance 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92 on hv-cinder-81398 Oct 29 01:29:51.511342 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [req-ccff1df1-7357-4205-a4ae-b74e376f9617 req-02682c23-4a8a-4a30-a874-b92496d1164b service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041180 Oct 29 01:29:51.512447 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 85/157] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Oct 29 01:29:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:29:51.537907 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-5f260bc6-54e8-4b28-9370-5738559107df tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:51.538665 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-5f260bc6-54e8-4b28-9370-5738559107df tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:51.545652 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-5f260bc6-54e8-4b28-9370-5738559107df tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:51.546098 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-5f260bc6-54e8-4b28-9370-5738559107df tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:51.546880 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-5f260bc6-54e8-4b28-9370-5738559107df tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:51.547309 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-5f260bc6-54e8-4b28-9370-5738559107df tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:51.550358 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-f1aacc54-4fc3-4f8c-ae56-451c3f5247e8 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:51.558218 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-f1aacc54-4fc3-4f8c-ae56-451c3f5247e8 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c" status: 200 len: 1521 microversion: 2.1 time: 0.173220 Oct 29 01:29:51.558802 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 73/158] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:29:51 2021] GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:51.756519 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-5f260bc6-54e8-4b28-9370-5738559107df tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045dda1ff9b44334954c08e63fcd20c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51a2093a0874d52a08f6e25489ba181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:51.764733 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-5f260bc6-54e8-4b28-9370-5738559107df tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92" status: 200 len: 1364 microversion: 2.1 time: 0.231255 Oct 29 01:29:51.765318 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 86/159] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:29:51 2021] GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92 => generated 1364 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:29:51.843298 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-76b93409-8c2d-4fdb-b9c0-04d56d08b535 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:51.844263 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-76b93409-8c2d-4fdb-b9c0-04d56d08b535 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:51.852935 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-76b93409-8c2d-4fdb-b9c0-04d56d08b535 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:51.853343 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-76b93409-8c2d-4fdb-b9c0-04d56d08b535 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:51.854275 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-76b93409-8c2d-4fdb-b9c0-04d56d08b535 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:51.854701 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-76b93409-8c2d-4fdb-b9c0-04d56d08b535 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:51.986528 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-a45b610e-5597-417e-be7e-3f8858f9687a tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d8579253-e2e5-42af-8fba-3b0e7fb5b355"}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:29:51.986528 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-a45b610e-5597-417e-be7e-3f8858f9687a tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] [instance: 52d47b4c-e32e-4708-ade4-0be86b270c03] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:51.992249 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a45b610e-5597-417e-be7e-3f8858f9687a tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:51.992764 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a45b610e-5597-417e-be7e-3f8858f9687a tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:51.993534 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a45b610e-5597-417e-be7e-3f8858f9687a tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:51.993962 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a45b610e-5597-417e-be7e-3f8858f9687a tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:51.998287 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-76b93409-8c2d-4fdb-b9c0-04d56d08b535 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:52.010739 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-76b93409-8c2d-4fdb-b9c0-04d56d08b535 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:52.012238 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-76b93409-8c2d-4fdb-b9c0-04d56d08b535 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:52.013319 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-76b93409-8c2d-4fdb-b9c0-04d56d08b535 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1406 microversion: 2.20 time: 0.174655 Oct 29 01:29:52.013879 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 74/160] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:29:51 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1406 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:29:52.576510 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-45800e38-3065-49cf-88c4-c0241f36c691 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:52.577271 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-45800e38-3065-49cf-88c4-c0241f36c691 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 8daa36f8-7d64-4d9d-94e6-0519848d4a2c] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:52.587119 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-45800e38-3065-49cf-88c4-c0241f36c691 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:52.592458 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-45800e38-3065-49cf-88c4-c0241f36c691 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:52.592458 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-45800e38-3065-49cf-88c4-c0241f36c691 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:52.592458 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-45800e38-3065-49cf-88c4-c0241f36c691 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:52.721472 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-45800e38-3065-49cf-88c4-c0241f36c691 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:52.730365 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-45800e38-3065-49cf-88c4-c0241f36c691 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c" status: 200 len: 1521 microversion: 2.1 time: 0.157971 Oct 29 01:29:52.731023 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 75/161] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:29:52 2021] GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:29:52.781853 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-db9b2a84-4c01-46c9-8aee-4b5afe40e0de tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:52.782487 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-db9b2a84-4c01-46c9-8aee-4b5afe40e0de tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:52.788427 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-db9b2a84-4c01-46c9-8aee-4b5afe40e0de tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:52.789982 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-db9b2a84-4c01-46c9-8aee-4b5afe40e0de tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:52.789982 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-db9b2a84-4c01-46c9-8aee-4b5afe40e0de tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:52.790181 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-db9b2a84-4c01-46c9-8aee-4b5afe40e0de tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:52.912720 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-db9b2a84-4c01-46c9-8aee-4b5afe40e0de tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045dda1ff9b44334954c08e63fcd20c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51a2093a0874d52a08f6e25489ba181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:52.920391 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-db9b2a84-4c01-46c9-8aee-4b5afe40e0de tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92" status: 200 len: 1364 microversion: 2.1 time: 0.142278 Oct 29 01:29:52.920954 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 76/162] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:29:52 2021] GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92 => generated 1364 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:29:53.031542 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-aae2a883-d889-42fa-af4c-55c3044df467 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:53.032259 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-aae2a883-d889-42fa-af4c-55c3044df467 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:53.038220 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-aae2a883-d889-42fa-af4c-55c3044df467 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:53.038661 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-aae2a883-d889-42fa-af4c-55c3044df467 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:53.039426 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-aae2a883-d889-42fa-af4c-55c3044df467 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:53.039897 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-aae2a883-d889-42fa-af4c-55c3044df467 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:53.163194 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-aae2a883-d889-42fa-af4c-55c3044df467 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:53.170967 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-aae2a883-d889-42fa-af4c-55c3044df467 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:53.173858 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-aae2a883-d889-42fa-af4c-55c3044df467 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:53.174219 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-aae2a883-d889-42fa-af4c-55c3044df467 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1406 microversion: 2.20 time: 0.146445 Oct 29 01:29:53.174814 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 77/163] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:29:53 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1406 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:29:53.747394 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-4167c6e6-0303-41ab-8410-9faec87dab31 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:53.748159 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-4167c6e6-0303-41ab-8410-9faec87dab31 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 8daa36f8-7d64-4d9d-94e6-0519848d4a2c] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:53.753963 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-4167c6e6-0303-41ab-8410-9faec87dab31 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:53.754403 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-4167c6e6-0303-41ab-8410-9faec87dab31 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:53.755192 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-4167c6e6-0303-41ab-8410-9faec87dab31 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:53.755616 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-4167c6e6-0303-41ab-8410-9faec87dab31 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:53.882359 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-4167c6e6-0303-41ab-8410-9faec87dab31 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:53.889651 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-4167c6e6-0303-41ab-8410-9faec87dab31 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c" status: 200 len: 1521 microversion: 2.1 time: 0.145844 Oct 29 01:29:53.890219 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 78/164] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:29:53 2021] GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:53.937078 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-4d9211eb-cb7a-4a01-900b-777e31d4a3eb tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:53.937674 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-4d9211eb-cb7a-4a01-900b-777e31d4a3eb tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:53.944739 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-4d9211eb-cb7a-4a01-900b-777e31d4a3eb tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:53.945178 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-4d9211eb-cb7a-4a01-900b-777e31d4a3eb tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:53.945936 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-4d9211eb-cb7a-4a01-900b-777e31d4a3eb tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:53.946435 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-4d9211eb-cb7a-4a01-900b-777e31d4a3eb tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:54.070623 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-4d9211eb-cb7a-4a01-900b-777e31d4a3eb tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045dda1ff9b44334954c08e63fcd20c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51a2093a0874d52a08f6e25489ba181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:54.078378 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-4d9211eb-cb7a-4a01-900b-777e31d4a3eb tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92" status: 200 len: 1364 microversion: 2.1 time: 0.144869 Oct 29 01:29:54.079154 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 79/165] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:29:53 2021] GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92 => generated 1364 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:29:54.192292 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-e251a5ac-8f56-43fc-94f0-18606cd30d48 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:54.192804 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-e251a5ac-8f56-43fc-94f0-18606cd30d48 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:54.198728 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-e251a5ac-8f56-43fc-94f0-18606cd30d48 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:54.199893 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-e251a5ac-8f56-43fc-94f0-18606cd30d48 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:54.200192 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-e251a5ac-8f56-43fc-94f0-18606cd30d48 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:54.200620 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-e251a5ac-8f56-43fc-94f0-18606cd30d48 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:54.320145 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-e251a5ac-8f56-43fc-94f0-18606cd30d48 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:54.328246 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-e251a5ac-8f56-43fc-94f0-18606cd30d48 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:54.330022 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-e251a5ac-8f56-43fc-94f0-18606cd30d48 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:54.331122 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-e251a5ac-8f56-43fc-94f0-18606cd30d48 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1406 microversion: 2.20 time: 0.142766 Oct 29 01:29:54.331681 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 80/166] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:29:54 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1406 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:29:54.908050 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-f4598845-b321-49ac-8932-0a206fffd605 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:54.908688 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-f4598845-b321-49ac-8932-0a206fffd605 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 8daa36f8-7d64-4d9d-94e6-0519848d4a2c] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:54.915217 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-f4598845-b321-49ac-8932-0a206fffd605 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:54.915689 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-f4598845-b321-49ac-8932-0a206fffd605 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:54.916487 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-f4598845-b321-49ac-8932-0a206fffd605 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:54.916920 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-f4598845-b321-49ac-8932-0a206fffd605 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:55.081882 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-f4598845-b321-49ac-8932-0a206fffd605 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:55.089582 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-f4598845-b321-49ac-8932-0a206fffd605 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c" status: 200 len: 1521 microversion: 2.1 time: 0.185313 Oct 29 01:29:55.090142 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 81/167] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:29:54 2021] GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:29:55.094646 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-2c477677-74e9-4596-8273-790281a70164 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:55.095629 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-2c477677-74e9-4596-8273-790281a70164 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:55.102170 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-2c477677-74e9-4596-8273-790281a70164 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:55.108999 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-2c477677-74e9-4596-8273-790281a70164 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:55.108999 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-2c477677-74e9-4596-8273-790281a70164 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:55.108999 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-2c477677-74e9-4596-8273-790281a70164 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:55.243500 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-2c477677-74e9-4596-8273-790281a70164 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045dda1ff9b44334954c08e63fcd20c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51a2093a0874d52a08f6e25489ba181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:55.252222 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-2c477677-74e9-4596-8273-790281a70164 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92" status: 200 len: 1364 microversion: 2.1 time: 0.161047 Oct 29 01:29:55.252798 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 82/168] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:29:55 2021] GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:55.350283 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-b5da9448-c965-4d93-a1ec-1f2b6dd606ff tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:55.350999 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-b5da9448-c965-4d93-a1ec-1f2b6dd606ff tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:55.357305 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-b5da9448-c965-4d93-a1ec-1f2b6dd606ff tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:55.357816 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-b5da9448-c965-4d93-a1ec-1f2b6dd606ff tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:55.358707 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-b5da9448-c965-4d93-a1ec-1f2b6dd606ff tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:55.359187 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-b5da9448-c965-4d93-a1ec-1f2b6dd606ff tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:55.491232 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-b5da9448-c965-4d93-a1ec-1f2b6dd606ff tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:55.499378 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-b5da9448-c965-4d93-a1ec-1f2b6dd606ff tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:55.501578 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-b5da9448-c965-4d93-a1ec-1f2b6dd606ff tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:55.502681 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-b5da9448-c965-4d93-a1ec-1f2b6dd606ff tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1406 microversion: 2.20 time: 0.156724 Oct 29 01:29:55.503230 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 83/169] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:29:55 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:29:55.905000 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-a45b610e-5597-417e-be7e-3f8858f9687a tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] 10.222.0.87 "POST /compute/v2.1/servers/52d47b4c-e32e-4708-ade4-0be86b270c03/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.924592 Oct 29 01:29:55.905713 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 87/170] 10.222.0.87 () {60 vars in 1322 bytes} [Fri Oct 29 01:29:51 2021] POST /compute/v2.1/servers/52d47b4c-e32e-4708-ade4-0be86b270c03/os-volume_attachments => generated 194 bytes in 3926 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:29:56.106272 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-cccd5f40-55ce-468b-ba26-7b864a452a35 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:56.106884 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-cccd5f40-55ce-468b-ba26-7b864a452a35 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 8daa36f8-7d64-4d9d-94e6-0519848d4a2c] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:56.113400 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-cccd5f40-55ce-468b-ba26-7b864a452a35 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:56.116168 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-cccd5f40-55ce-468b-ba26-7b864a452a35 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:56.116168 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-cccd5f40-55ce-468b-ba26-7b864a452a35 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:56.116168 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-cccd5f40-55ce-468b-ba26-7b864a452a35 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:56.250090 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-cccd5f40-55ce-468b-ba26-7b864a452a35 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:56.258100 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-cccd5f40-55ce-468b-ba26-7b864a452a35 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c" status: 200 len: 1521 microversion: 2.1 time: 0.155322 Oct 29 01:29:56.258722 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 84/171] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:29:56 2021] GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:56.270350 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-8011b9fb-4764-46ad-8c5f-9188cad7062f tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:56.271038 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-8011b9fb-4764-46ad-8c5f-9188cad7062f tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:56.277196 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-8011b9fb-4764-46ad-8c5f-9188cad7062f tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:56.277630 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-8011b9fb-4764-46ad-8c5f-9188cad7062f tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:56.278383 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-8011b9fb-4764-46ad-8c5f-9188cad7062f tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:56.278805 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-8011b9fb-4764-46ad-8c5f-9188cad7062f tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:56.412545 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-8011b9fb-4764-46ad-8c5f-9188cad7062f tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045dda1ff9b44334954c08e63fcd20c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51a2093a0874d52a08f6e25489ba181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:56.424375 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-8011b9fb-4764-46ad-8c5f-9188cad7062f tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92" status: 200 len: 1364 microversion: 2.1 time: 0.158651 Oct 29 01:29:56.424954 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 88/172] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:29:56 2021] GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92 => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:56.521328 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-c193ecc9-5be1-4d72-924e-da1b19bc4e41 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:56.521960 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-c193ecc9-5be1-4d72-924e-da1b19bc4e41 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:56.534010 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-c193ecc9-5be1-4d72-924e-da1b19bc4e41 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:56.534010 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-c193ecc9-5be1-4d72-924e-da1b19bc4e41 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:56.534010 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-c193ecc9-5be1-4d72-924e-da1b19bc4e41 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:56.534010 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-c193ecc9-5be1-4d72-924e-da1b19bc4e41 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:56.672882 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-c193ecc9-5be1-4d72-924e-da1b19bc4e41 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:56.680836 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-c193ecc9-5be1-4d72-924e-da1b19bc4e41 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:56.682377 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-c193ecc9-5be1-4d72-924e-da1b19bc4e41 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:56.683508 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-c193ecc9-5be1-4d72-924e-da1b19bc4e41 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1598 microversion: 2.20 time: 0.166166 Oct 29 01:29:56.684088 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 85/173] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:29:56 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1598 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:29:56.702214 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-796c8815-e042-4368-9a58-479997018f81 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:56.711823 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-796c8815-e042-4368-9a58-479997018f81 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:56.711823 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-796c8815-e042-4368-9a58-479997018f81 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:56.711823 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-796c8815-e042-4368-9a58-479997018f81 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:56.711823 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-796c8815-e042-4368-9a58-479997018f81 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:56.712303 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-796c8815-e042-4368-9a58-479997018f81 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:56.832658 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-796c8815-e042-4368-9a58-479997018f81 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.134377 Oct 29 01:29:56.833244 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 89/174] 10.222.0.87 () {60 vars in 1315 bytes} [Fri Oct 29 01:29:56 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/os-interface => generated 284 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 01:29:57.276038 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-806ea7ce-390d-4fac-abfa-0185fdacb0e9 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:57.280558 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-806ea7ce-390d-4fac-abfa-0185fdacb0e9 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 8daa36f8-7d64-4d9d-94e6-0519848d4a2c] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:57.282843 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-806ea7ce-390d-4fac-abfa-0185fdacb0e9 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:57.283290 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-806ea7ce-390d-4fac-abfa-0185fdacb0e9 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:57.284097 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-806ea7ce-390d-4fac-abfa-0185fdacb0e9 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:57.284528 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-806ea7ce-390d-4fac-abfa-0185fdacb0e9 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:57.441905 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-90fff8ae-67f4-4d29-8b74-8e6eded91a4f tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:57.443318 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-90fff8ae-67f4-4d29-8b74-8e6eded91a4f tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:57.449808 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-90fff8ae-67f4-4d29-8b74-8e6eded91a4f tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:57.450259 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-90fff8ae-67f4-4d29-8b74-8e6eded91a4f tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:57.451126 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-90fff8ae-67f4-4d29-8b74-8e6eded91a4f tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:57.451559 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-90fff8ae-67f4-4d29-8b74-8e6eded91a4f tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:57.616235 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-806ea7ce-390d-4fac-abfa-0185fdacb0e9 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:57.624327 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-806ea7ce-390d-4fac-abfa-0185fdacb0e9 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c" status: 200 len: 1521 microversion: 2.1 time: 0.351883 Oct 29 01:29:57.624913 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 86/175] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:29:57 2021] GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c => generated 1521 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:57.818510 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-90fff8ae-67f4-4d29-8b74-8e6eded91a4f tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045dda1ff9b44334954c08e63fcd20c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51a2093a0874d52a08f6e25489ba181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:57.828323 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-90fff8ae-67f4-4d29-8b74-8e6eded91a4f tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92" status: 200 len: 1550 microversion: 2.1 time: 0.391221 Oct 29 01:29:57.830540 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 90/176] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:29:57 2021] GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92 => generated 1550 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:29:57.849785 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-96bfa157-47d0-4d9d-9fee-8d62198627f4 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:57.850279 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-96bfa157-47d0-4d9d-9fee-8d62198627f4 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:57.856677 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-96bfa157-47d0-4d9d-9fee-8d62198627f4 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:57.857175 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-96bfa157-47d0-4d9d-9fee-8d62198627f4 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:57.857929 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-96bfa157-47d0-4d9d-9fee-8d62198627f4 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:57.858388 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-96bfa157-47d0-4d9d-9fee-8d62198627f4 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:57.951457 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-96bfa157-47d0-4d9d-9fee-8d62198627f4 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.108770 Oct 29 01:29:57.952295 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 87/177] 10.222.0.87 () {58 vars in 1274 bytes} [Fri Oct 29 01:29:57 2021] GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/os-interface => generated 285 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:29:58.483340 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-8844d2ae-8e11-49ce-adda-63b2e26e6319 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:29:58.484354 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-8844d2ae-8e11-49ce-adda-63b2e26e6319 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:58.491506 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [req-197852f6-060d-451c-9668-15be40509d4f req-e75e5b9a-2b5d-4406-969d-93ae39fb5b08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f64f5ebf-8af1-4507-849e-b7d8e33979ae", "tag": "01153800-bf44-4376-854e-aec24743a4d7"}]} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:29:58.493086 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:29:58.493086 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: warnings.warn(msg) Oct 29 01:29:58.503992 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-8844d2ae-8e11-49ce-adda-63b2e26e6319 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:58.506640 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-8844d2ae-8e11-49ce-adda-63b2e26e6319 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:58.507287 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [req-197852f6-060d-451c-9668-15be40509d4f req-e75e5b9a-2b5d-4406-969d-93ae39fb5b08 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:58.508268 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-8844d2ae-8e11-49ce-adda-63b2e26e6319 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:58.508845 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [req-197852f6-060d-451c-9668-15be40509d4f req-e75e5b9a-2b5d-4406-969d-93ae39fb5b08 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:58.510486 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-8844d2ae-8e11-49ce-adda-63b2e26e6319 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:58.533592 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.compute.server_external_events [req-197852f6-060d-451c-9668-15be40509d4f req-e75e5b9a-2b5d-4406-969d-93ae39fb5b08 service nova] Creating event network-changed:01153800-bf44-4376-854e-aec24743a4d7 for instance f64f5ebf-8af1-4507-849e-b7d8e33979ae on hv-cinder-81398 Oct 29 01:29:58.545930 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [req-197852f6-060d-451c-9668-15be40509d4f req-e75e5b9a-2b5d-4406-969d-93ae39fb5b08 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057638 Oct 29 01:29:58.548902 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 88/178] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Oct 29 01:29:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:29:58.623292 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-8844d2ae-8e11-49ce-adda-63b2e26e6319 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action" status: 200 len: 14 microversion: 2.20 time: 0.143285 Oct 29 01:29:58.624609 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 91/179] 10.222.0.87 () {62 vars in 1318 bytes} [Fri Oct 29 01:29:58 2021] POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action => generated 14 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:58.643875 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-25fa6de7-8e87-4519-b358-ac37419a509a tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:58.644973 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-25fa6de7-8e87-4519-b358-ac37419a509a tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 8daa36f8-7d64-4d9d-94e6-0519848d4a2c] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:58.652386 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-25fa6de7-8e87-4519-b358-ac37419a509a tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:58.653044 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-25fa6de7-8e87-4519-b358-ac37419a509a tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:58.654247 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-25fa6de7-8e87-4519-b358-ac37419a509a tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:58.664919 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-25fa6de7-8e87-4519-b358-ac37419a509a tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:58.957623 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-25fa6de7-8e87-4519-b358-ac37419a509a tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:29:58.968578 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-25fa6de7-8e87-4519-b358-ac37419a509a tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c" status: 200 len: 1521 microversion: 2.1 time: 0.330235 Oct 29 01:29:58.971391 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 89/180] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:29:58 2021] GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c => generated 1521 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:29:59.528892 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-535e5ddb-f5fe-42dd-83d2-6e869e73bc61 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:29:59.529887 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-535e5ddb-f5fe-42dd-83d2-6e869e73bc61 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:59.532997 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [req-034cd67c-8aaa-46ca-958d-bd7cf3f7851c req-17c54cc1-7c49-4d84-84f0-6358e29311c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cc2f3ec-53ba-4b8c-a02a-236f8564eb92", "tag": "d40854b4-c7cf-4c79-ba60-0ea2a73669e5"}]} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:29:59.534133 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:29:59.534133 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: warnings.warn(msg) Oct 29 01:29:59.548678 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-535e5ddb-f5fe-42dd-83d2-6e869e73bc61 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:59.549125 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-535e5ddb-f5fe-42dd-83d2-6e869e73bc61 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:59.551181 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-535e5ddb-f5fe-42dd-83d2-6e869e73bc61 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:59.551181 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-535e5ddb-f5fe-42dd-83d2-6e869e73bc61 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:59.573582 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [req-034cd67c-8aaa-46ca-958d-bd7cf3f7851c req-17c54cc1-7c49-4d84-84f0-6358e29311c9 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:59.574279 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [req-034cd67c-8aaa-46ca-958d-bd7cf3f7851c req-17c54cc1-7c49-4d84-84f0-6358e29311c9 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:59.592428 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.compute.server_external_events [req-034cd67c-8aaa-46ca-958d-bd7cf3f7851c req-17c54cc1-7c49-4d84-84f0-6358e29311c9 service nova] Creating event network-changed:d40854b4-c7cf-4c79-ba60-0ea2a73669e5 for instance 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92 on hv-cinder-81398 Oct 29 01:29:59.599642 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [req-034cd67c-8aaa-46ca-958d-bd7cf3f7851c req-17c54cc1-7c49-4d84-84f0-6358e29311c9 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071417 Oct 29 01:29:59.600291 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 90/181] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Oct 29 01:29:59 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:29:59.642246 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-2313df22-9979-4278-8926-ef804132c292 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:29:59.643722 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-2313df22-9979-4278-8926-ef804132c292 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:29:59.653470 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-2313df22-9979-4278-8926-ef804132c292 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:59.653908 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-2313df22-9979-4278-8926-ef804132c292 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:59.654862 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-2313df22-9979-4278-8926-ef804132c292 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:29:59.655293 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-2313df22-9979-4278-8926-ef804132c292 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:29:59.669296 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-535e5ddb-f5fe-42dd-83d2-6e869e73bc61 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action" status: 200 len: 14 microversion: 2.1 time: 0.145106 Oct 29 01:29:59.673426 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 92/182] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:29:59 2021] POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action => generated 14 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:29:59.778265 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-2313df22-9979-4278-8926-ef804132c292 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action" status: 200 len: 14 microversion: 2.20 time: 0.142948 Oct 29 01:29:59.779986 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 91/183] 10.222.0.87 () {62 vars in 1318 bytes} [Fri Oct 29 01:29:59 2021] POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action => generated 14 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:29:59.989130 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-b8a7f625-1714-4926-b450-577ed0c649dd tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:29:59.990542 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-b8a7f625-1714-4926-b450-577ed0c649dd tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 8daa36f8-7d64-4d9d-94e6-0519848d4a2c] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:00.001400 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-b8a7f625-1714-4926-b450-577ed0c649dd tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:00.002232 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-b8a7f625-1714-4926-b450-577ed0c649dd tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:00.003270 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-b8a7f625-1714-4926-b450-577ed0c649dd tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:00.003923 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-b8a7f625-1714-4926-b450-577ed0c649dd tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:00.230420 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-b8a7f625-1714-4926-b450-577ed0c649dd tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:00.251415 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-b8a7f625-1714-4926-b450-577ed0c649dd tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c" status: 200 len: 1521 microversion: 2.1 time: 0.256266 Oct 29 01:30:00.251415 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 93/184] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:29:59 2021] GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c => generated 1521 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:00.682550 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-66daafbe-a53f-476c-824d-c1f8b2601b6b tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:00.683752 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-66daafbe-a53f-476c-824d-c1f8b2601b6b tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:00.692000 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-66daafbe-a53f-476c-824d-c1f8b2601b6b tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:00.696161 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-66daafbe-a53f-476c-824d-c1f8b2601b6b tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:00.696161 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-66daafbe-a53f-476c-824d-c1f8b2601b6b tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:00.696161 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-66daafbe-a53f-476c-824d-c1f8b2601b6b tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:00.786489 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-66daafbe-a53f-476c-824d-c1f8b2601b6b tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action" status: 200 len: 14 microversion: 2.1 time: 0.108594 Oct 29 01:30:00.787110 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 92/185] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:30:00 2021] POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action => generated 14 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:30:00.789868 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-45c47c92-9859-47f3-84c5-aa9353d257ab tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:00.790881 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-45c47c92-9859-47f3-84c5-aa9353d257ab tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:00.798427 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-45c47c92-9859-47f3-84c5-aa9353d257ab tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:00.798956 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-45c47c92-9859-47f3-84c5-aa9353d257ab tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:00.799718 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-45c47c92-9859-47f3-84c5-aa9353d257ab tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:00.800547 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-45c47c92-9859-47f3-84c5-aa9353d257ab tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:00.872123 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-45c47c92-9859-47f3-84c5-aa9353d257ab tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action" status: 200 len: 14 microversion: 2.20 time: 0.085666 Oct 29 01:30:00.873222 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 94/186] 10.222.0.87 () {62 vars in 1318 bytes} [Fri Oct 29 01:30:00 2021] POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action => generated 14 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:30:01.261372 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-fdfd6d93-96ba-4161-bc21-9ad6d76d0d25 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:01.264473 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-fdfd6d93-96ba-4161-bc21-9ad6d76d0d25 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 8daa36f8-7d64-4d9d-94e6-0519848d4a2c] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:01.269437 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-fdfd6d93-96ba-4161-bc21-9ad6d76d0d25 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:01.269726 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-fdfd6d93-96ba-4161-bc21-9ad6d76d0d25 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:01.270561 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-fdfd6d93-96ba-4161-bc21-9ad6d76d0d25 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:01.270902 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-fdfd6d93-96ba-4161-bc21-9ad6d76d0d25 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:01.409710 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-fdfd6d93-96ba-4161-bc21-9ad6d76d0d25 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:01.417020 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-fdfd6d93-96ba-4161-bc21-9ad6d76d0d25 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c" status: 200 len: 1521 microversion: 2.1 time: 0.160736 Oct 29 01:30:01.417587 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 93/187] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:01 2021] GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:01.797277 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-8a86f0e9-593b-4ed3-b505-fde7672796d5 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:01.798378 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-8a86f0e9-593b-4ed3-b505-fde7672796d5 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:01.805276 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-8a86f0e9-593b-4ed3-b505-fde7672796d5 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:01.805803 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-8a86f0e9-593b-4ed3-b505-fde7672796d5 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:01.806700 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-8a86f0e9-593b-4ed3-b505-fde7672796d5 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:01.807586 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-8a86f0e9-593b-4ed3-b505-fde7672796d5 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:01.886837 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-8a86f0e9-593b-4ed3-b505-fde7672796d5 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action" status: 200 len: 14 microversion: 2.1 time: 0.093405 Oct 29 01:30:01.887593 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 95/188] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:30:01 2021] POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:30:01.890143 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-d36eb965-26f3-41a5-9e41-507eaeefb164 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:01.892300 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-d36eb965-26f3-41a5-9e41-507eaeefb164 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:01.899928 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d36eb965-26f3-41a5-9e41-507eaeefb164 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:01.899928 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d36eb965-26f3-41a5-9e41-507eaeefb164 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:01.900626 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d36eb965-26f3-41a5-9e41-507eaeefb164 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:01.901208 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d36eb965-26f3-41a5-9e41-507eaeefb164 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:01.988334 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-d36eb965-26f3-41a5-9e41-507eaeefb164 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action" status: 200 len: 14 microversion: 2.20 time: 0.101701 Oct 29 01:30:01.991781 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 94/189] 10.222.0.87 () {62 vars in 1318 bytes} [Fri Oct 29 01:30:01 2021] POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action => generated 14 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:02.434220 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-1de32ffa-3393-47ea-818e-a14f6f9fed06 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:02.434901 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-1de32ffa-3393-47ea-818e-a14f6f9fed06 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 8daa36f8-7d64-4d9d-94e6-0519848d4a2c] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:02.441715 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-1de32ffa-3393-47ea-818e-a14f6f9fed06 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:02.442160 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-1de32ffa-3393-47ea-818e-a14f6f9fed06 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:02.442925 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-1de32ffa-3393-47ea-818e-a14f6f9fed06 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:02.443353 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-1de32ffa-3393-47ea-818e-a14f6f9fed06 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:02.619507 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-1de32ffa-3393-47ea-818e-a14f6f9fed06 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:02.631711 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-1de32ffa-3393-47ea-818e-a14f6f9fed06 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c" status: 200 len: 1521 microversion: 2.1 time: 0.197686 Oct 29 01:30:02.631711 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 96/190] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:02 2021] GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:02.899250 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-16ac614c-f429-4015-bbc4-2ced2a9e9daf tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:02.900488 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-16ac614c-f429-4015-bbc4-2ced2a9e9daf tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:02.909018 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-16ac614c-f429-4015-bbc4-2ced2a9e9daf tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:02.909609 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-16ac614c-f429-4015-bbc4-2ced2a9e9daf tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:02.910432 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-16ac614c-f429-4015-bbc4-2ced2a9e9daf tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:02.910842 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-16ac614c-f429-4015-bbc4-2ced2a9e9daf tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:02.991068 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-16ac614c-f429-4015-bbc4-2ced2a9e9daf tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action" status: 200 len: 14 microversion: 2.1 time: 0.096102 Oct 29 01:30:02.991804 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 95/191] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:30:02 2021] POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action => generated 14 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:30:02.999826 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-1d6e72fd-0783-451b-af8d-ae2341e4a4c1 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:03.002042 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-1d6e72fd-0783-451b-af8d-ae2341e4a4c1 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:03.008664 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-1d6e72fd-0783-451b-af8d-ae2341e4a4c1 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:03.009184 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-1d6e72fd-0783-451b-af8d-ae2341e4a4c1 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:03.009929 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-1d6e72fd-0783-451b-af8d-ae2341e4a4c1 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:03.010356 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-1d6e72fd-0783-451b-af8d-ae2341e4a4c1 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:03.093871 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-1d6e72fd-0783-451b-af8d-ae2341e4a4c1 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action" status: 200 len: 14 microversion: 2.20 time: 0.097727 Oct 29 01:30:03.094695 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 97/192] 10.222.0.87 () {62 vars in 1318 bytes} [Fri Oct 29 01:30:02 2021] POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action => generated 14 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:03.644990 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-a3b4cf6f-d284-46f9-ad5b-eaa9174d9157 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:03.645669 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-a3b4cf6f-d284-46f9-ad5b-eaa9174d9157 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 8daa36f8-7d64-4d9d-94e6-0519848d4a2c] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:03.652493 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-a3b4cf6f-d284-46f9-ad5b-eaa9174d9157 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:03.652977 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-a3b4cf6f-d284-46f9-ad5b-eaa9174d9157 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:03.653729 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-a3b4cf6f-d284-46f9-ad5b-eaa9174d9157 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:03.654186 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-a3b4cf6f-d284-46f9-ad5b-eaa9174d9157 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:03.786368 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-a3b4cf6f-d284-46f9-ad5b-eaa9174d9157 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:03.794468 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-a3b4cf6f-d284-46f9-ad5b-eaa9174d9157 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c" status: 200 len: 1521 microversion: 2.1 time: 0.153621 Oct 29 01:30:03.795036 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 96/193] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:03 2021] GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:04.003044 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-228af23c-39f7-4629-9160-ce922cf57428 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:04.004259 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-228af23c-39f7-4629-9160-ce922cf57428 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:04.012261 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-228af23c-39f7-4629-9160-ce922cf57428 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:04.012548 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-228af23c-39f7-4629-9160-ce922cf57428 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:04.013327 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-228af23c-39f7-4629-9160-ce922cf57428 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:04.013742 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-228af23c-39f7-4629-9160-ce922cf57428 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:04.091068 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-228af23c-39f7-4629-9160-ce922cf57428 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action" status: 200 len: 14 microversion: 2.1 time: 0.092072 Oct 29 01:30:04.091752 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 98/194] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:30:03 2021] POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:30:04.106419 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-56512a95-e8e0-47d4-b4fc-16c75ea97d06 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:04.109083 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-56512a95-e8e0-47d4-b4fc-16c75ea97d06 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:04.114829 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-56512a95-e8e0-47d4-b4fc-16c75ea97d06 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:04.115408 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-56512a95-e8e0-47d4-b4fc-16c75ea97d06 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:04.116249 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-56512a95-e8e0-47d4-b4fc-16c75ea97d06 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:04.116719 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-56512a95-e8e0-47d4-b4fc-16c75ea97d06 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:04.200125 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-56512a95-e8e0-47d4-b4fc-16c75ea97d06 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action" status: 200 len: 14 microversion: 2.20 time: 0.097003 Oct 29 01:30:04.201004 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 97/195] 10.222.0.87 () {62 vars in 1318 bytes} [Fri Oct 29 01:30:04 2021] POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action => generated 14 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:04.814688 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-7c795682-4d45-4741-81c5-a65df54d6270 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:04.815967 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-7c795682-4d45-4741-81c5-a65df54d6270 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 8daa36f8-7d64-4d9d-94e6-0519848d4a2c] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:04.822928 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-7c795682-4d45-4741-81c5-a65df54d6270 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:04.823322 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-7c795682-4d45-4741-81c5-a65df54d6270 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:04.824335 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-7c795682-4d45-4741-81c5-a65df54d6270 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:04.825079 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-7c795682-4d45-4741-81c5-a65df54d6270 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:04.958456 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-7c795682-4d45-4741-81c5-a65df54d6270 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:04.972177 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-7c795682-4d45-4741-81c5-a65df54d6270 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c" status: 200 len: 1521 microversion: 2.1 time: 0.160641 Oct 29 01:30:04.975809 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 99/196] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:04 2021] GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:05.108759 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-0b709167-def2-448f-aa40-a4d7da77f305 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:05.111012 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-0b709167-def2-448f-aa40-a4d7da77f305 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:05.122409 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-0b709167-def2-448f-aa40-a4d7da77f305 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:05.122409 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-0b709167-def2-448f-aa40-a4d7da77f305 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:05.122409 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-0b709167-def2-448f-aa40-a4d7da77f305 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:05.122409 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-0b709167-def2-448f-aa40-a4d7da77f305 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:05.214899 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-e7c6f27b-3530-4a44-96aa-28b8a19917bf tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:05.219923 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-e7c6f27b-3530-4a44-96aa-28b8a19917bf tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:05.222461 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-0b709167-def2-448f-aa40-a4d7da77f305 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action" status: 200 len: 14 microversion: 2.1 time: 0.118646 Oct 29 01:30:05.224504 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 98/197] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:30:05 2021] POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action => generated 14 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:30:05.227131 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-e7c6f27b-3530-4a44-96aa-28b8a19917bf tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:05.228242 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-e7c6f27b-3530-4a44-96aa-28b8a19917bf tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:05.229800 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-e7c6f27b-3530-4a44-96aa-28b8a19917bf tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:05.230808 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-e7c6f27b-3530-4a44-96aa-28b8a19917bf tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:05.345388 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-e7c6f27b-3530-4a44-96aa-28b8a19917bf tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action" status: 200 len: 14 microversion: 2.20 time: 0.134724 Oct 29 01:30:05.347067 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 100/198] 10.222.0.87 () {62 vars in 1318 bytes} [Fri Oct 29 01:30:05 2021] POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action => generated 14 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:30:05.700074 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-7adbc9d8-ea11-434c-b7ab-073d54ce44a3 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:05.701094 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-7adbc9d8-ea11-434c-b7ab-073d54ce44a3 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] [instance: 52d47b4c-e32e-4708-ade4-0be86b270c03] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:05.709183 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-7adbc9d8-ea11-434c-b7ab-073d54ce44a3 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:05.709824 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-7adbc9d8-ea11-434c-b7ab-073d54ce44a3 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:05.710706 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-7adbc9d8-ea11-434c-b7ab-073d54ce44a3 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:05.711208 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-7adbc9d8-ea11-434c-b7ab-073d54ce44a3 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:05.742834 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-7adbc9d8-ea11-434c-b7ab-073d54ce44a3 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] [instance: 52d47b4c-e32e-4708-ade4-0be86b270c03] Going to try to terminate instance {{(pid=116379) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 29 01:30:05.989666 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-1e1fa629-ca45-4f8b-9b5f-cddeb9f6b8bc tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:05.990636 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-1e1fa629-ca45-4f8b-9b5f-cddeb9f6b8bc tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 8daa36f8-7d64-4d9d-94e6-0519848d4a2c] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:05.998446 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-1e1fa629-ca45-4f8b-9b5f-cddeb9f6b8bc tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:05.998982 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-1e1fa629-ca45-4f8b-9b5f-cddeb9f6b8bc tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:05.999891 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-1e1fa629-ca45-4f8b-9b5f-cddeb9f6b8bc tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:06.001097 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-1e1fa629-ca45-4f8b-9b5f-cddeb9f6b8bc tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:06.135413 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-7adbc9d8-ea11-434c-b7ab-073d54ce44a3 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] 10.222.0.87 "DELETE /compute/v2.1/servers/52d47b4c-e32e-4708-ade4-0be86b270c03" status: 204 len: 0 microversion: 2.1 time: 0.439408 Oct 29 01:30:06.136145 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 99/199] 10.222.0.87 () {58 vars in 1238 bytes} [Fri Oct 29 01:30:05 2021] DELETE /compute/v2.1/servers/52d47b4c-e32e-4708-ade4-0be86b270c03 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:30:06.144479 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-4d640e9f-5b86-4791-818e-c45ba5135a9f tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:06.145182 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-4d640e9f-5b86-4791-818e-c45ba5135a9f tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] [instance: 52d47b4c-e32e-4708-ade4-0be86b270c03] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:06.151664 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-4d640e9f-5b86-4791-818e-c45ba5135a9f tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:06.152270 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-4d640e9f-5b86-4791-818e-c45ba5135a9f tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:06.154044 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-4d640e9f-5b86-4791-818e-c45ba5135a9f tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:06.154572 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-4d640e9f-5b86-4791-818e-c45ba5135a9f tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:06.158316 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-1e1fa629-ca45-4f8b-9b5f-cddeb9f6b8bc tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:06.174238 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-1e1fa629-ca45-4f8b-9b5f-cddeb9f6b8bc tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c" status: 200 len: 1521 microversion: 2.1 time: 0.190216 Oct 29 01:30:06.190881 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 101/200] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:05 2021] GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:30:06.238449 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-a9e5a2d2-b3ff-4ef2-9fba-0b5eb25aba08 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:06.242691 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-a9e5a2d2-b3ff-4ef2-9fba-0b5eb25aba08 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:06.254919 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a9e5a2d2-b3ff-4ef2-9fba-0b5eb25aba08 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:06.256060 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a9e5a2d2-b3ff-4ef2-9fba-0b5eb25aba08 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:06.257788 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a9e5a2d2-b3ff-4ef2-9fba-0b5eb25aba08 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:06.258877 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a9e5a2d2-b3ff-4ef2-9fba-0b5eb25aba08 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:06.341637 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-4d640e9f-5b86-4791-818e-c45ba5135a9f tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df16eb9ac1b7472ebe95d3739604e27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1a96bc2154de787f2d217b2ac27f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:06.349723 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-4d640e9f-5b86-4791-818e-c45ba5135a9f tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] 10.222.0.87 "GET /compute/v2.1/servers/52d47b4c-e32e-4708-ade4-0be86b270c03" status: 200 len: 1552 microversion: 2.1 time: 0.209276 Oct 29 01:30:06.351668 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 100/201] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:06 2021] GET /compute/v2.1/servers/52d47b4c-e32e-4708-ade4-0be86b270c03 => generated 1552 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:30:06.362731 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-6c52a105-b612-44ed-8852-c62a4c5af7bf tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:06.363843 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-6c52a105-b612-44ed-8852-c62a4c5af7bf tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:06.370235 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-6c52a105-b612-44ed-8852-c62a4c5af7bf tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:06.371827 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-6c52a105-b612-44ed-8852-c62a4c5af7bf tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:06.371827 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-6c52a105-b612-44ed-8852-c62a4c5af7bf tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:06.372011 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-6c52a105-b612-44ed-8852-c62a4c5af7bf tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:09.919965 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-6c52a105-b612-44ed-8852-c62a4c5af7bf tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action" status: 200 len: 14 microversion: 2.20 time: 3.561189 Oct 29 01:30:09.920636 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 101/202] 10.222.0.87 () {62 vars in 1318 bytes} [Fri Oct 29 01:30:06 2021] POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action => generated 14 bytes in 3563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:09.925478 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-88bf0c84-6a0d-4595-8004-9d6eb41b76fc tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:09.926158 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-88bf0c84-6a0d-4595-8004-9d6eb41b76fc tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 8daa36f8-7d64-4d9d-94e6-0519848d4a2c] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:09.927999 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-a9e5a2d2-b3ff-4ef2-9fba-0b5eb25aba08 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action" status: 200 len: 14 microversion: 2.1 time: 3.696533 Oct 29 01:30:09.931384 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 102/203] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:30:06 2021] POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action => generated 14 bytes in 3701 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:30:09.932943 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-88bf0c84-6a0d-4595-8004-9d6eb41b76fc tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:09.933384 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-88bf0c84-6a0d-4595-8004-9d6eb41b76fc tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:09.934311 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-88bf0c84-6a0d-4595-8004-9d6eb41b76fc tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:09.934747 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-88bf0c84-6a0d-4595-8004-9d6eb41b76fc tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:09.936585 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-191d0e4a-563b-44e2-8826-541ae9642669 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:09.938018 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-191d0e4a-563b-44e2-8826-541ae9642669 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] [instance: 52d47b4c-e32e-4708-ade4-0be86b270c03] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:09.944777 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-191d0e4a-563b-44e2-8826-541ae9642669 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:09.945533 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-191d0e4a-563b-44e2-8826-541ae9642669 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:09.947090 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-191d0e4a-563b-44e2-8826-541ae9642669 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:09.948102 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-191d0e4a-563b-44e2-8826-541ae9642669 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:10.173041 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-88bf0c84-6a0d-4595-8004-9d6eb41b76fc tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:10.182723 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-88bf0c84-6a0d-4595-8004-9d6eb41b76fc tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c" status: 200 len: 1521 microversion: 2.1 time: 0.260684 Oct 29 01:30:10.185553 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 102/204] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:09 2021] GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c => generated 1521 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:10.186513 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-191d0e4a-563b-44e2-8826-541ae9642669 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df16eb9ac1b7472ebe95d3739604e27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1a96bc2154de787f2d217b2ac27f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:10.200656 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-191d0e4a-563b-44e2-8826-541ae9642669 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] 10.222.0.87 "GET /compute/v2.1/servers/52d47b4c-e32e-4708-ade4-0be86b270c03" status: 200 len: 1552 microversion: 2.1 time: 0.267679 Oct 29 01:30:10.204832 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 103/205] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:09 2021] GET /compute/v2.1/servers/52d47b4c-e32e-4708-ade4-0be86b270c03 => generated 1552 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:10.931745 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-71aada13-a595-4e58-bf0d-ba20520e7d32 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:10.932557 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-71aada13-a595-4e58-bf0d-ba20520e7d32 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:10.939166 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-71aada13-a595-4e58-bf0d-ba20520e7d32 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:10.939608 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-71aada13-a595-4e58-bf0d-ba20520e7d32 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:10.940255 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-ba49d285-665b-4331-8d30-99b3a2111056 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:10.940715 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-71aada13-a595-4e58-bf0d-ba20520e7d32 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:10.940850 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-71aada13-a595-4e58-bf0d-ba20520e7d32 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:10.941163 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-ba49d285-665b-4331-8d30-99b3a2111056 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:10.947931 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ba49d285-665b-4331-8d30-99b3a2111056 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:10.948537 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ba49d285-665b-4331-8d30-99b3a2111056 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:10.949804 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ba49d285-665b-4331-8d30-99b3a2111056 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:10.950231 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ba49d285-665b-4331-8d30-99b3a2111056 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:11.085796 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-71aada13-a595-4e58-bf0d-ba20520e7d32 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action" status: 200 len: 14 microversion: 2.20 time: 0.158870 Oct 29 01:30:11.087672 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 103/206] 10.222.0.87 () {62 vars in 1318 bytes} [Fri Oct 29 01:30:10 2021] POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action => generated 14 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:11.091975 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-ba49d285-665b-4331-8d30-99b3a2111056 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action" status: 200 len: 14 microversion: 2.1 time: 0.151907 Oct 29 01:30:11.091975 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 104/207] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:30:10 2021] POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action => generated 14 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 29 01:30:11.201922 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-ab945ef9-57c3-40ce-b893-2209ecb5d69d tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:11.204709 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-ab945ef9-57c3-40ce-b893-2209ecb5d69d tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 8daa36f8-7d64-4d9d-94e6-0519848d4a2c] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:11.210278 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-ab945ef9-57c3-40ce-b893-2209ecb5d69d tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:11.210727 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-ab945ef9-57c3-40ce-b893-2209ecb5d69d tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:11.211489 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-ab945ef9-57c3-40ce-b893-2209ecb5d69d tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:11.212047 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-ab945ef9-57c3-40ce-b893-2209ecb5d69d tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:11.220912 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-02903dbe-54a4-473e-8dea-a9e52aa7606b tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:11.223832 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-02903dbe-54a4-473e-8dea-a9e52aa7606b tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] [instance: 52d47b4c-e32e-4708-ade4-0be86b270c03] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:11.229560 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-02903dbe-54a4-473e-8dea-a9e52aa7606b tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:11.230281 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-02903dbe-54a4-473e-8dea-a9e52aa7606b tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:11.231274 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-02903dbe-54a4-473e-8dea-a9e52aa7606b tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:11.232007 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-02903dbe-54a4-473e-8dea-a9e52aa7606b tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:11.434304 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-02903dbe-54a4-473e-8dea-a9e52aa7606b tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df16eb9ac1b7472ebe95d3739604e27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1a96bc2154de787f2d217b2ac27f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:11.439332 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-ab945ef9-57c3-40ce-b893-2209ecb5d69d tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:11.444136 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-02903dbe-54a4-473e-8dea-a9e52aa7606b tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] 10.222.0.87 "GET /compute/v2.1/servers/52d47b4c-e32e-4708-ade4-0be86b270c03" status: 200 len: 1552 microversion: 2.1 time: 0.228478 Oct 29 01:30:11.445115 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 105/208] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:11 2021] GET /compute/v2.1/servers/52d47b4c-e32e-4708-ade4-0be86b270c03 => generated 1552 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:30:11.447180 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-ab945ef9-57c3-40ce-b893-2209ecb5d69d tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c" status: 200 len: 1521 microversion: 2.1 time: 0.250808 Oct 29 01:30:11.447757 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 104/209] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:11 2021] GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c => generated 1521 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:11.450827 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-931a8e52-0992-425f-9f8b-b8fc92f98832 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-616755834", "imageRef": "3b1d5dc6-2b04-4433-9a93-1db6a740092b", "flavorRef": "452", "networks": [{"uuid": "07cc0a5c-d93c-4a3a-918e-e24f7df3a1ac"}]}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:11.519857 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.network.neutron [None req-931a8e52-0992-425f-9f8b-b8fc92f98832 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] validate_networks() for [('07cc0a5c-d93c-4a3a-918e-e24f7df3a1ac', None, None, None, None, None)] {{(pid=116378) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 29 01:30:11.867782 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.virt.hardware [None req-931a8e52-0992-425f-9f8b-b8fc92f98832 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Flavor limits 0:0:0 {{(pid=116378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:30:11.868205 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.virt.hardware [None req-931a8e52-0992-425f-9f8b-b8fc92f98832 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Image limits 0:0:0 {{(pid=116378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:30:11.868672 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.virt.hardware [None req-931a8e52-0992-425f-9f8b-b8fc92f98832 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Flavor pref 0:0:0 {{(pid=116378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:30:11.869073 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.virt.hardware [None req-931a8e52-0992-425f-9f8b-b8fc92f98832 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Image pref 0:0:0 {{(pid=116378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:30:11.870417 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.virt.hardware [None req-931a8e52-0992-425f-9f8b-b8fc92f98832 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:30:11.883184 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-931a8e52-0992-425f-9f8b-b8fc92f98832 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:11.883184 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-931a8e52-0992-425f-9f8b-b8fc92f98832 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:11.883975 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-931a8e52-0992-425f-9f8b-b8fc92f98832 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:11.884407 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-931a8e52-0992-425f-9f8b-b8fc92f98832 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:11.900985 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.quota [None req-931a8e52-0992-425f-9f8b-b8fc92f98832 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Getting quotas for project 131e8f4d098e4d2ba64328c91f63c18c. Resources: {'instances', 'cores', 'ram'} {{(pid=116378) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 01:30:11.904901 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.quota [None req-931a8e52-0992-425f-9f8b-b8fc92f98832 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Getting quotas for user 5b2dbc6652b34cd3a4fc39dbabd839bc and project 131e8f4d098e4d2ba64328c91f63c18c. Resources: {'instances', 'cores', 'ram'} {{(pid=116378) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 01:30:11.915891 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-931a8e52-0992-425f-9f8b-b8fc92f98832 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Going to run 1 instances... {{(pid=116378) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 29 01:30:11.918185 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-931a8e52-0992-425f-9f8b-b8fc92f98832 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] [instance: df8051e5-6f5b-47e6-9659-02de55bdfee4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3b1d5dc6-2b04-4433-9a93-1db6a740092b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116378) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 29 01:30:12.062640 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-931a8e52-0992-425f-9f8b-b8fc92f98832 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.616272 Oct 29 01:30:12.063375 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 106/210] 10.222.0.87 () {60 vars in 1146 bytes} [Fri Oct 29 01:30:11 2021] POST /compute/v2.1/servers => generated 380 bytes in 617 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:30:12.073295 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-b0318e46-b00e-4850-bac7-122765235381 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:12.074381 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-b0318e46-b00e-4850-bac7-122765235381 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] [instance: df8051e5-6f5b-47e6-9659-02de55bdfee4] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:12.101184 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-22ffb5f7-fb57-4006-886b-fbea43d6b840 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:12.102303 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-22ffb5f7-fb57-4006-886b-fbea43d6b840 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:12.111062 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-22ffb5f7-fb57-4006-886b-fbea43d6b840 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:12.111510 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-22ffb5f7-fb57-4006-886b-fbea43d6b840 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:12.112324 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-22ffb5f7-fb57-4006-886b-fbea43d6b840 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:12.112754 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-22ffb5f7-fb57-4006-886b-fbea43d6b840 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:12.129506 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-b0318e46-b00e-4850-bac7-122765235381 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2dbc6652b34cd3a4fc39dbabd839bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131e8f4d098e4d2ba64328c91f63c18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:12.137545 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-b0318e46-b00e-4850-bac7-122765235381 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] 10.222.0.87 "GET /compute/v2.1/servers/df8051e5-6f5b-47e6-9659-02de55bdfee4" status: 200 len: 1213 microversion: 2.1 time: 0.067755 Oct 29 01:30:12.138316 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 105/211] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:12 2021] GET /compute/v2.1/servers/df8051e5-6f5b-47e6-9659-02de55bdfee4 => generated 1213 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:30:12.147496 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-4cc0a2d0-0218-45e6-9633-035a9e3d23d9 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:12.148567 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-4cc0a2d0-0218-45e6-9633-035a9e3d23d9 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:12.154976 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-4cc0a2d0-0218-45e6-9633-035a9e3d23d9 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:12.155429 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-4cc0a2d0-0218-45e6-9633-035a9e3d23d9 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:12.156919 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-4cc0a2d0-0218-45e6-9633-035a9e3d23d9 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:12.157388 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-4cc0a2d0-0218-45e6-9633-035a9e3d23d9 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:12.282730 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-4cc0a2d0-0218-45e6-9633-035a9e3d23d9 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action" status: 200 len: 14 microversion: 2.20 time: 0.142919 Oct 29 01:30:12.283360 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 106/212] 10.222.0.87 () {62 vars in 1318 bytes} [Fri Oct 29 01:30:12 2021] POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action => generated 14 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:12.303482 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-22ffb5f7-fb57-4006-886b-fbea43d6b840 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action" status: 200 len: 14 microversion: 2.1 time: 0.205846 Oct 29 01:30:12.304153 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 107/213] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:30:12 2021] POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action => generated 14 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:30:12.462030 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-b4d735f2-7947-4962-bf5f-0d00efab265e tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:12.463198 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-b4d735f2-7947-4962-bf5f-0d00efab265e tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] [instance: 52d47b4c-e32e-4708-ade4-0be86b270c03] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:12.470734 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-da087f41-b54c-47ae-bcc0-7a775f3ace15 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:12.471130 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-b4d735f2-7947-4962-bf5f-0d00efab265e tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:12.471445 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-da087f41-b54c-47ae-bcc0-7a775f3ace15 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 8daa36f8-7d64-4d9d-94e6-0519848d4a2c] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:12.471523 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-b4d735f2-7947-4962-bf5f-0d00efab265e tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:12.472310 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-b4d735f2-7947-4962-bf5f-0d00efab265e tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:12.472834 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-b4d735f2-7947-4962-bf5f-0d00efab265e tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:12.479650 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-da087f41-b54c-47ae-bcc0-7a775f3ace15 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:12.480121 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-da087f41-b54c-47ae-bcc0-7a775f3ace15 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:12.485759 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-da087f41-b54c-47ae-bcc0-7a775f3ace15 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:12.486664 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-da087f41-b54c-47ae-bcc0-7a775f3ace15 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:12.691460 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-b4d735f2-7947-4962-bf5f-0d00efab265e tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df16eb9ac1b7472ebe95d3739604e27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1a96bc2154de787f2d217b2ac27f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:12.693603 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-da087f41-b54c-47ae-bcc0-7a775f3ace15 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:12.700109 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-b4d735f2-7947-4962-bf5f-0d00efab265e tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] 10.222.0.87 "GET /compute/v2.1/servers/52d47b4c-e32e-4708-ade4-0be86b270c03" status: 200 len: 1552 microversion: 2.1 time: 0.241777 Oct 29 01:30:12.700903 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 107/214] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:12 2021] GET /compute/v2.1/servers/52d47b4c-e32e-4708-ade4-0be86b270c03 => generated 1552 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:12.712446 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-da087f41-b54c-47ae-bcc0-7a775f3ace15 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c" status: 200 len: 1521 microversion: 2.1 time: 0.248256 Oct 29 01:30:12.713036 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 108/215] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:12 2021] GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c => generated 1521 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:30:13.155703 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-d7be393f-955e-42ba-b398-fdfc3cadfd02 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:13.156378 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-d7be393f-955e-42ba-b398-fdfc3cadfd02 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] [instance: df8051e5-6f5b-47e6-9659-02de55bdfee4] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:13.163476 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d7be393f-955e-42ba-b398-fdfc3cadfd02 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:13.163996 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d7be393f-955e-42ba-b398-fdfc3cadfd02 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:13.164761 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d7be393f-955e-42ba-b398-fdfc3cadfd02 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:13.165187 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d7be393f-955e-42ba-b398-fdfc3cadfd02 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:13.230941 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-d7be393f-955e-42ba-b398-fdfc3cadfd02 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2dbc6652b34cd3a4fc39dbabd839bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131e8f4d098e4d2ba64328c91f63c18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:13.238778 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-d7be393f-955e-42ba-b398-fdfc3cadfd02 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] 10.222.0.87 "GET /compute/v2.1/servers/df8051e5-6f5b-47e6-9659-02de55bdfee4" status: 200 len: 1217 microversion: 2.1 time: 0.086707 Oct 29 01:30:13.239372 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 108/216] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:13 2021] GET /compute/v2.1/servers/df8051e5-6f5b-47e6-9659-02de55bdfee4 => generated 1217 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:13.293108 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-43cc8ac2-8845-43f9-99b3-3389898e604d tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:13.294006 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-43cc8ac2-8845-43f9-99b3-3389898e604d tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:13.300264 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-43cc8ac2-8845-43f9-99b3-3389898e604d tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:13.300709 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-43cc8ac2-8845-43f9-99b3-3389898e604d tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:13.301505 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-43cc8ac2-8845-43f9-99b3-3389898e604d tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:13.301906 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-43cc8ac2-8845-43f9-99b3-3389898e604d tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:13.316083 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-21d50fe1-cae7-4d87-8735-57c71ec982e6 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:13.317359 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-21d50fe1-cae7-4d87-8735-57c71ec982e6 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:13.325276 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-21d50fe1-cae7-4d87-8735-57c71ec982e6 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:13.325836 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-21d50fe1-cae7-4d87-8735-57c71ec982e6 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:13.326688 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-21d50fe1-cae7-4d87-8735-57c71ec982e6 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:13.327185 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-21d50fe1-cae7-4d87-8735-57c71ec982e6 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:13.452886 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-43cc8ac2-8845-43f9-99b3-3389898e604d tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action" status: 200 len: 14 microversion: 2.20 time: 0.163256 Oct 29 01:30:13.453522 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 109/217] 10.222.0.87 () {62 vars in 1318 bytes} [Fri Oct 29 01:30:13 2021] POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action => generated 14 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:30:13.490341 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-21d50fe1-cae7-4d87-8735-57c71ec982e6 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action" status: 200 len: 14 microversion: 2.1 time: 0.178702 Oct 29 01:30:13.491157 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 109/218] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:30:13 2021] POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action => generated 14 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:30:13.717993 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-f6c74333-dcef-47f6-8525-559676ed03e8 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:13.718789 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-f6c74333-dcef-47f6-8525-559676ed03e8 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] [instance: 52d47b4c-e32e-4708-ade4-0be86b270c03] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:13.734365 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-f6c74333-dcef-47f6-8525-559676ed03e8 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:13.734938 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-f6c74333-dcef-47f6-8525-559676ed03e8 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:13.738312 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-0bd53bda-7983-46ba-bf79-4dcf9edcf1af tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:13.739357 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-f6c74333-dcef-47f6-8525-559676ed03e8 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:13.739928 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-f6c74333-dcef-47f6-8525-559676ed03e8 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:13.740974 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-0bd53bda-7983-46ba-bf79-4dcf9edcf1af tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 8daa36f8-7d64-4d9d-94e6-0519848d4a2c] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:13.751426 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-0bd53bda-7983-46ba-bf79-4dcf9edcf1af tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:13.752156 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-0bd53bda-7983-46ba-bf79-4dcf9edcf1af tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:13.753019 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-0bd53bda-7983-46ba-bf79-4dcf9edcf1af tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:13.753456 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-0bd53bda-7983-46ba-bf79-4dcf9edcf1af tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:14.200926 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-f6c74333-dcef-47f6-8525-559676ed03e8 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df16eb9ac1b7472ebe95d3739604e27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1a96bc2154de787f2d217b2ac27f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:14.212015 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-f6c74333-dcef-47f6-8525-559676ed03e8 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] 10.222.0.87 "GET /compute/v2.1/servers/52d47b4c-e32e-4708-ade4-0be86b270c03" status: 200 len: 1552 microversion: 2.1 time: 0.498043 Oct 29 01:30:14.212685 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 110/219] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:13 2021] GET /compute/v2.1/servers/52d47b4c-e32e-4708-ade4-0be86b270c03 => generated 1552 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:14.214314 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-0bd53bda-7983-46ba-bf79-4dcf9edcf1af tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:14.222792 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-0bd53bda-7983-46ba-bf79-4dcf9edcf1af tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c" status: 200 len: 1521 microversion: 2.1 time: 0.496051 Oct 29 01:30:14.223714 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 110/220] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:13 2021] GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c => generated 1521 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:30:14.255798 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-4eda4c9b-4b6f-4344-a3d2-e8c07a39b6d0 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:14.256396 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-4eda4c9b-4b6f-4344-a3d2-e8c07a39b6d0 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] [instance: df8051e5-6f5b-47e6-9659-02de55bdfee4] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:14.263216 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4eda4c9b-4b6f-4344-a3d2-e8c07a39b6d0 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:14.263653 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4eda4c9b-4b6f-4344-a3d2-e8c07a39b6d0 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:14.264449 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4eda4c9b-4b6f-4344-a3d2-e8c07a39b6d0 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:14.264871 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4eda4c9b-4b6f-4344-a3d2-e8c07a39b6d0 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:14.330427 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-4eda4c9b-4b6f-4344-a3d2-e8c07a39b6d0 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2dbc6652b34cd3a4fc39dbabd839bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131e8f4d098e4d2ba64328c91f63c18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:14.337583 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-4eda4c9b-4b6f-4344-a3d2-e8c07a39b6d0 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] 10.222.0.87 "GET /compute/v2.1/servers/df8051e5-6f5b-47e6-9659-02de55bdfee4" status: 200 len: 1265 microversion: 2.1 time: 0.085480 Oct 29 01:30:14.338178 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 111/221] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:14 2021] GET /compute/v2.1/servers/df8051e5-6f5b-47e6-9659-02de55bdfee4 => generated 1265 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:14.463757 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-918602dd-884e-4d3b-b176-997dc5f971bf tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:14.468788 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-918602dd-884e-4d3b-b176-997dc5f971bf tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:14.471648 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-918602dd-884e-4d3b-b176-997dc5f971bf tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:14.472113 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-918602dd-884e-4d3b-b176-997dc5f971bf tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:14.472895 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-918602dd-884e-4d3b-b176-997dc5f971bf tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:14.473318 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-918602dd-884e-4d3b-b176-997dc5f971bf tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:14.509129 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-1a337d93-80fc-4436-9f36-dc856be513cd tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:14.510112 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-1a337d93-80fc-4436-9f36-dc856be513cd tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:14.522001 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-1a337d93-80fc-4436-9f36-dc856be513cd tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:14.522451 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-1a337d93-80fc-4436-9f36-dc856be513cd tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:14.523266 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-1a337d93-80fc-4436-9f36-dc856be513cd tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:14.523696 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-1a337d93-80fc-4436-9f36-dc856be513cd tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:14.554849 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-918602dd-884e-4d3b-b176-997dc5f971bf tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action" status: 200 len: 14 microversion: 2.20 time: 0.094658 Oct 29 01:30:14.555669 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 111/222] 10.222.0.87 () {62 vars in 1318 bytes} [Fri Oct 29 01:30:14 2021] POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:14.628010 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [req-26b9c114-d77f-473c-ad26-59c9369aa69a req-702f1dfe-b7b6-49d8-ba81-e637775d34d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52d47b4c-e32e-4708-ade4-0be86b270c03", "name": "network-vif-deleted", "tag": "7c7389c9-c004-43ca-b348-25bb91613962"}]} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:14.628930 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-1a337d93-80fc-4436-9f36-dc856be513cd tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action" status: 200 len: 14 microversion: 2.1 time: 0.129627 Oct 29 01:30:14.629510 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:30:14.629510 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: warnings.warn(msg) Oct 29 01:30:14.629736 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 112/223] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:30:14 2021] POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action => generated 14 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:30:14.638386 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [req-26b9c114-d77f-473c-ad26-59c9369aa69a req-702f1dfe-b7b6-49d8-ba81-e637775d34d8 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:14.638818 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [req-26b9c114-d77f-473c-ad26-59c9369aa69a req-702f1dfe-b7b6-49d8-ba81-e637775d34d8 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:14.650331 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.compute.server_external_events [req-26b9c114-d77f-473c-ad26-59c9369aa69a req-702f1dfe-b7b6-49d8-ba81-e637775d34d8 service nova] Creating event network-vif-deleted:7c7389c9-c004-43ca-b348-25bb91613962 for instance 52d47b4c-e32e-4708-ade4-0be86b270c03 on hv-cinder-81398 Oct 29 01:30:14.655277 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [req-26b9c114-d77f-473c-ad26-59c9369aa69a req-702f1dfe-b7b6-49d8-ba81-e637775d34d8 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031322 Oct 29 01:30:14.655904 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 112/224] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Oct 29 01:30:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:30:15.231081 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-16889515-29ca-486a-8f50-6cc487c0c014 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:15.231609 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-16889515-29ca-486a-8f50-6cc487c0c014 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] [instance: 52d47b4c-e32e-4708-ade4-0be86b270c03] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:15.241594 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-6e901878-fa83-447b-b847-a0f884fbbac3 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:15.242552 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-6e901878-fa83-447b-b847-a0f884fbbac3 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 8daa36f8-7d64-4d9d-94e6-0519848d4a2c] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:15.248254 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-16889515-29ca-486a-8f50-6cc487c0c014 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:15.248254 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-16889515-29ca-486a-8f50-6cc487c0c014 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:15.248986 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-16889515-29ca-486a-8f50-6cc487c0c014 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:15.249315 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-16889515-29ca-486a-8f50-6cc487c0c014 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:15.255429 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-6e901878-fa83-447b-b847-a0f884fbbac3 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:15.257810 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-6e901878-fa83-447b-b847-a0f884fbbac3 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:15.258810 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-6e901878-fa83-447b-b847-a0f884fbbac3 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:15.259900 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-6e901878-fa83-447b-b847-a0f884fbbac3 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:15.363577 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-16889515-29ca-486a-8f50-6cc487c0c014 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df16eb9ac1b7472ebe95d3739604e27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1a96bc2154de787f2d217b2ac27f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:15.371803 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-16889515-29ca-486a-8f50-6cc487c0c014 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] 10.222.0.87 "GET /compute/v2.1/servers/52d47b4c-e32e-4708-ade4-0be86b270c03" status: 200 len: 1345 microversion: 2.1 time: 0.145307 Oct 29 01:30:15.372632 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 113/225] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:15 2021] GET /compute/v2.1/servers/52d47b4c-e32e-4708-ade4-0be86b270c03 => generated 1345 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:15.381283 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-0814d871-a530-461f-b542-488c8ea84a11 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:15.382708 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-0814d871-a530-461f-b542-488c8ea84a11 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] [instance: df8051e5-6f5b-47e6-9659-02de55bdfee4] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:15.389871 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-0814d871-a530-461f-b542-488c8ea84a11 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:15.390684 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-0814d871-a530-461f-b542-488c8ea84a11 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:15.391911 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-0814d871-a530-461f-b542-488c8ea84a11 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:15.392596 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-0814d871-a530-461f-b542-488c8ea84a11 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:15.495326 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-0814d871-a530-461f-b542-488c8ea84a11 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2dbc6652b34cd3a4fc39dbabd839bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131e8f4d098e4d2ba64328c91f63c18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:15.504448 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-0814d871-a530-461f-b542-488c8ea84a11 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] 10.222.0.87 "GET /compute/v2.1/servers/df8051e5-6f5b-47e6-9659-02de55bdfee4" status: 200 len: 1271 microversion: 2.1 time: 0.130480 Oct 29 01:30:15.514189 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 114/226] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:15 2021] GET /compute/v2.1/servers/df8051e5-6f5b-47e6-9659-02de55bdfee4 => generated 1271 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:15.556046 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-6e901878-fa83-447b-b847-a0f884fbbac3 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:15.563536 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-6e901878-fa83-447b-b847-a0f884fbbac3 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c" status: 200 len: 1521 microversion: 2.1 time: 0.326964 Oct 29 01:30:15.564791 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 113/227] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:15 2021] GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c => generated 1521 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:15.567845 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-739b61a7-4a17-439f-b570-35e56c88c862 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:15.569116 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-739b61a7-4a17-439f-b570-35e56c88c862 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:15.578752 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-739b61a7-4a17-439f-b570-35e56c88c862 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:15.579244 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-739b61a7-4a17-439f-b570-35e56c88c862 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:15.580064 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-739b61a7-4a17-439f-b570-35e56c88c862 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:15.580493 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-739b61a7-4a17-439f-b570-35e56c88c862 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:15.647150 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-02162197-6b14-414a-a26d-00e45a24ec94 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:15.647150 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-02162197-6b14-414a-a26d-00e45a24ec94 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:15.653691 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-739b61a7-4a17-439f-b570-35e56c88c862 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action" status: 200 len: 14 microversion: 2.20 time: 0.089840 Oct 29 01:30:15.654403 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-02162197-6b14-414a-a26d-00e45a24ec94 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:15.654856 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-02162197-6b14-414a-a26d-00e45a24ec94 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:15.655157 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 115/228] 10.222.0.87 () {62 vars in 1318 bytes} [Fri Oct 29 01:30:15 2021] POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:30:15.656373 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-02162197-6b14-414a-a26d-00e45a24ec94 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:15.656798 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-02162197-6b14-414a-a26d-00e45a24ec94 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:15.752967 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-02162197-6b14-414a-a26d-00e45a24ec94 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action" status: 200 len: 14 microversion: 2.1 time: 0.116141 Oct 29 01:30:15.753781 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 114/229] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:30:15 2021] POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action => generated 14 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 29 01:30:16.390790 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-63fab8b3-976c-4c77-af64-94ad3c085d2a tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:16.391486 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-63fab8b3-976c-4c77-af64-94ad3c085d2a tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] [instance: 52d47b4c-e32e-4708-ade4-0be86b270c03] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:16.399035 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-63fab8b3-976c-4c77-af64-94ad3c085d2a tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:16.399659 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-63fab8b3-976c-4c77-af64-94ad3c085d2a tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:16.400634 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-63fab8b3-976c-4c77-af64-94ad3c085d2a tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:16.401242 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-63fab8b3-976c-4c77-af64-94ad3c085d2a tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:16.436650 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-63fab8b3-976c-4c77-af64-94ad3c085d2a tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:16.437124 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-63fab8b3-976c-4c77-af64-94ad3c085d2a tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:16.437646 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.objects.instance [None req-63fab8b3-976c-4c77-af64-94ad3c085d2a tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lazy-loading 'fault' on Instance uuid 52d47b4c-e32e-4708-ade4-0be86b270c03 {{(pid=116378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 01:30:16.484337 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-63fab8b3-976c-4c77-af64-94ad3c085d2a tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df16eb9ac1b7472ebe95d3739604e27b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb1a96bc2154de787f2d217b2ac27f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:16.494825 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-63fab8b3-976c-4c77-af64-94ad3c085d2a tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] 10.222.0.87 "GET /compute/v2.1/servers/52d47b4c-e32e-4708-ade4-0be86b270c03" status: 200 len: 1350 microversion: 2.1 time: 0.108103 Oct 29 01:30:16.506702 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 116/230] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:16 2021] GET /compute/v2.1/servers/52d47b4c-e32e-4708-ade4-0be86b270c03 => generated 1350 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:16.525406 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-9e2cd4a9-c8ea-4167-b355-725f10327b3c tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:16.526106 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-9e2cd4a9-c8ea-4167-b355-725f10327b3c tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] [instance: df8051e5-6f5b-47e6-9659-02de55bdfee4] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:16.534357 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-9e2cd4a9-c8ea-4167-b355-725f10327b3c tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:16.534807 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-9e2cd4a9-c8ea-4167-b355-725f10327b3c tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:16.535585 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-9e2cd4a9-c8ea-4167-b355-725f10327b3c tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:16.536049 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-9e2cd4a9-c8ea-4167-b355-725f10327b3c tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:16.581345 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-92c4881d-736f-4b4f-a047-387f39f752ce tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:16.581828 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-92c4881d-736f-4b4f-a047-387f39f752ce tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 8daa36f8-7d64-4d9d-94e6-0519848d4a2c] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:16.589102 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-92c4881d-736f-4b4f-a047-387f39f752ce tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:16.589543 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-92c4881d-736f-4b4f-a047-387f39f752ce tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:16.591327 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-92c4881d-736f-4b4f-a047-387f39f752ce tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:16.591327 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-92c4881d-736f-4b4f-a047-387f39f752ce tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:16.840016 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-9e2cd4a9-c8ea-4167-b355-725f10327b3c tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2dbc6652b34cd3a4fc39dbabd839bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131e8f4d098e4d2ba64328c91f63c18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:16.843640 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-9e2cd4a9-c8ea-4167-b355-725f10327b3c tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] 10.222.0.87 "GET /compute/v2.1/servers/df8051e5-6f5b-47e6-9659-02de55bdfee4" status: 200 len: 1313 microversion: 2.1 time: 0.322430 Oct 29 01:30:16.844245 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 115/231] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:16 2021] GET /compute/v2.1/servers/df8051e5-6f5b-47e6-9659-02de55bdfee4 => generated 1313 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:30:16.848786 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-4629b23a-6822-45ff-855b-b1e8ee9c3de8 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:16.849733 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-4629b23a-6822-45ff-855b-b1e8ee9c3de8 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:16.856065 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-4629b23a-6822-45ff-855b-b1e8ee9c3de8 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:16.856516 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-4629b23a-6822-45ff-855b-b1e8ee9c3de8 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:16.863660 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-4629b23a-6822-45ff-855b-b1e8ee9c3de8 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:16.863660 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-4629b23a-6822-45ff-855b-b1e8ee9c3de8 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:16.866977 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-92c4881d-736f-4b4f-a047-387f39f752ce tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:16.878583 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-92c4881d-736f-4b4f-a047-387f39f752ce tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c" status: 200 len: 1521 microversion: 2.1 time: 0.300772 Oct 29 01:30:16.890170 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 117/232] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:16 2021] GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c => generated 1521 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:30:16.895910 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-def5e7fc-1499-4f8f-9400-bb3a50441c29 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:16.897006 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-def5e7fc-1499-4f8f-9400-bb3a50441c29 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:16.909299 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-def5e7fc-1499-4f8f-9400-bb3a50441c29 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:16.909963 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-def5e7fc-1499-4f8f-9400-bb3a50441c29 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:16.910823 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-def5e7fc-1499-4f8f-9400-bb3a50441c29 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:16.911256 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-def5e7fc-1499-4f8f-9400-bb3a50441c29 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:16.972927 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-4629b23a-6822-45ff-855b-b1e8ee9c3de8 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action" status: 200 len: 14 microversion: 2.20 time: 0.127340 Oct 29 01:30:16.976445 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 116/233] 10.222.0.87 () {62 vars in 1318 bytes} [Fri Oct 29 01:30:16 2021] POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action => generated 14 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:17.011873 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-def5e7fc-1499-4f8f-9400-bb3a50441c29 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action" status: 200 len: 14 microversion: 2.1 time: 0.120142 Oct 29 01:30:17.012809 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 118/234] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:30:16 2021] POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action => generated 14 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:30:17.046981 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [req-1550b37e-73c4-4403-ba00-91a108275cb0 req-1391198a-ad29-4342-bd09-2bb89006f002 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df8051e5-6f5b-47e6-9659-02de55bdfee4", "tag": "e2181a7c-4599-4336-b587-33fe8cb2e717"}]} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:17.049362 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:30:17.049362 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: warnings.warn(msg) Oct 29 01:30:17.057155 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [req-1550b37e-73c4-4403-ba00-91a108275cb0 req-1391198a-ad29-4342-bd09-2bb89006f002 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:17.057589 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [req-1550b37e-73c4-4403-ba00-91a108275cb0 req-1391198a-ad29-4342-bd09-2bb89006f002 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:17.069249 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.compute.server_external_events [req-1550b37e-73c4-4403-ba00-91a108275cb0 req-1391198a-ad29-4342-bd09-2bb89006f002 service nova] Creating event network-changed:e2181a7c-4599-4336-b587-33fe8cb2e717 for instance df8051e5-6f5b-47e6-9659-02de55bdfee4 on hv-cinder-81398 Oct 29 01:30:17.073791 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [req-1550b37e-73c4-4403-ba00-91a108275cb0 req-1391198a-ad29-4342-bd09-2bb89006f002 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031457 Oct 29 01:30:17.074382 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 117/235] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Oct 29 01:30:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:30:17.518781 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-16194416-4981-4db3-bbd0-4a3206f616d8 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:17.520153 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-16194416-4981-4db3-bbd0-4a3206f616d8 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] [instance: 52d47b4c-e32e-4708-ade4-0be86b270c03] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:17.527108 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-16194416-4981-4db3-bbd0-4a3206f616d8 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:17.527548 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-16194416-4981-4db3-bbd0-4a3206f616d8 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:17.528334 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-16194416-4981-4db3-bbd0-4a3206f616d8 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:17.528961 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-16194416-4981-4db3-bbd0-4a3206f616d8 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:17.544138 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.wsgi [None req-16194416-4981-4db3-bbd0-4a3206f616d8 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] HTTP exception thrown: Instance 52d47b4c-e32e-4708-ade4-0be86b270c03 could not be found. Oct 29 01:30:17.544726 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-16194416-4981-4db3-bbd0-4a3206f616d8 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Returning 404 to user: Instance 52d47b4c-e32e-4708-ade4-0be86b270c03 could not be found. {{(pid=116378) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:30:17.545545 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-16194416-4981-4db3-bbd0-4a3206f616d8 tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] 10.222.0.87 "GET /compute/v2.1/servers/52d47b4c-e32e-4708-ade4-0be86b270c03" status: 404 len: 111 microversion: 2.1 time: 0.030887 Oct 29 01:30:17.546090 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 119/236] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:17 2021] GET /compute/v2.1/servers/52d47b4c-e32e-4708-ade4-0be86b270c03 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:30:17.660211 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-6bd1c56e-4cb4-45c5-b102-a900e78750fe tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:17.661192 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-6bd1c56e-4cb4-45c5-b102-a900e78750fe tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] [instance: 52d47b4c-e32e-4708-ade4-0be86b270c03] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:17.667126 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-6bd1c56e-4cb4-45c5-b102-a900e78750fe tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:17.672051 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-6bd1c56e-4cb4-45c5-b102-a900e78750fe tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:17.672051 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-6bd1c56e-4cb4-45c5-b102-a900e78750fe tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:17.672051 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-6bd1c56e-4cb4-45c5-b102-a900e78750fe tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:17.681025 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.wsgi [None req-6bd1c56e-4cb4-45c5-b102-a900e78750fe tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] HTTP exception thrown: Instance 52d47b4c-e32e-4708-ade4-0be86b270c03 could not be found. Oct 29 01:30:17.681699 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-6bd1c56e-4cb4-45c5-b102-a900e78750fe tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Returning 404 to user: Instance 52d47b4c-e32e-4708-ade4-0be86b270c03 could not be found. {{(pid=116379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:30:17.682435 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-6bd1c56e-4cb4-45c5-b102-a900e78750fe tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] 10.222.0.87 "GET /compute/v2.1/servers/52d47b4c-e32e-4708-ade4-0be86b270c03/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.027379 Oct 29 01:30:17.683008 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 118/237] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Oct 29 01:30:17 2021] GET /compute/v2.1/servers/52d47b4c-e32e-4708-ade4-0be86b270c03/os-volume_attachments => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:30:17.861220 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-54204f77-0317-438b-9a63-474a8a880132 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:17.861725 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-54204f77-0317-438b-9a63-474a8a880132 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] [instance: df8051e5-6f5b-47e6-9659-02de55bdfee4] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:17.880950 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-54204f77-0317-438b-9a63-474a8a880132 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:17.881409 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-54204f77-0317-438b-9a63-474a8a880132 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:17.882237 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-54204f77-0317-438b-9a63-474a8a880132 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:17.882675 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-54204f77-0317-438b-9a63-474a8a880132 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:17.896750 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-7136da8a-aa8c-4469-bdb8-09a0ae2d9629 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:17.897432 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-7136da8a-aa8c-4469-bdb8-09a0ae2d9629 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 8daa36f8-7d64-4d9d-94e6-0519848d4a2c] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:17.903631 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-7136da8a-aa8c-4469-bdb8-09a0ae2d9629 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:17.904109 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-7136da8a-aa8c-4469-bdb8-09a0ae2d9629 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:17.904874 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-7136da8a-aa8c-4469-bdb8-09a0ae2d9629 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:17.905299 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-7136da8a-aa8c-4469-bdb8-09a0ae2d9629 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:18.170569 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-54204f77-0317-438b-9a63-474a8a880132 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2dbc6652b34cd3a4fc39dbabd839bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131e8f4d098e4d2ba64328c91f63c18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:18.180996 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-54204f77-0317-438b-9a63-474a8a880132 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] 10.222.0.87 "GET /compute/v2.1/servers/df8051e5-6f5b-47e6-9659-02de55bdfee4" status: 200 len: 1313 microversion: 2.1 time: 0.324194 Oct 29 01:30:18.181944 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 120/238] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:17 2021] GET /compute/v2.1/servers/df8051e5-6f5b-47e6-9659-02de55bdfee4 => generated 1313 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:18.186501 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-1ba0c041-1886-4cfe-a817-99613105a040 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:18.187492 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-1ba0c041-1886-4cfe-a817-99613105a040 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:18.190081 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-7136da8a-aa8c-4469-bdb8-09a0ae2d9629 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:18.199142 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-7136da8a-aa8c-4469-bdb8-09a0ae2d9629 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c" status: 200 len: 1521 microversion: 2.1 time: 0.306123 Oct 29 01:30:18.200096 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-1ba0c041-1886-4cfe-a817-99613105a040 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:18.200536 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-1ba0c041-1886-4cfe-a817-99613105a040 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:18.200895 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 119/239] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:17 2021] GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c => generated 1521 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:30:18.201691 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-1ba0c041-1886-4cfe-a817-99613105a040 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:18.202356 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-1ba0c041-1886-4cfe-a817-99613105a040 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:18.206567 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-0a06ae4e-e08a-4e20-930a-4c8d5532e7c7 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:18.207538 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-0a06ae4e-e08a-4e20-930a-4c8d5532e7c7 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:18.215524 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-0a06ae4e-e08a-4e20-930a-4c8d5532e7c7 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:18.216152 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-0a06ae4e-e08a-4e20-930a-4c8d5532e7c7 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:18.218659 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-0a06ae4e-e08a-4e20-930a-4c8d5532e7c7 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:18.219280 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-0a06ae4e-e08a-4e20-930a-4c8d5532e7c7 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:18.321452 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-1ba0c041-1886-4cfe-a817-99613105a040 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action" status: 200 len: 14 microversion: 2.20 time: 0.138117 Oct 29 01:30:18.322099 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 121/240] 10.222.0.87 () {62 vars in 1318 bytes} [Fri Oct 29 01:30:18 2021] POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action => generated 14 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:18.505810 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-0a06ae4e-e08a-4e20-930a-4c8d5532e7c7 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action" status: 200 len: 14 microversion: 2.1 time: 0.303516 Oct 29 01:30:18.506514 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 120/241] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:30:18 2021] POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action => generated 14 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:30:19.121806 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-08d9d847-2f45-46d2-b3bb-194a2814fc6e tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:19.122492 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-08d9d847-2f45-46d2-b3bb-194a2814fc6e tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] [instance: 52d47b4c-e32e-4708-ade4-0be86b270c03] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:19.129453 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-08d9d847-2f45-46d2-b3bb-194a2814fc6e tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:19.129893 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-08d9d847-2f45-46d2-b3bb-194a2814fc6e tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:19.130656 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-08d9d847-2f45-46d2-b3bb-194a2814fc6e tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:19.131078 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-08d9d847-2f45-46d2-b3bb-194a2814fc6e tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:19.145703 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.wsgi [None req-08d9d847-2f45-46d2-b3bb-194a2814fc6e tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] HTTP exception thrown: Instance 52d47b4c-e32e-4708-ade4-0be86b270c03 could not be found. Oct 29 01:30:19.146460 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-08d9d847-2f45-46d2-b3bb-194a2814fc6e tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Returning 404 to user: Instance 52d47b4c-e32e-4708-ade4-0be86b270c03 could not be found. {{(pid=116378) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:30:19.147272 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-08d9d847-2f45-46d2-b3bb-194a2814fc6e tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] 10.222.0.87 "DELETE /compute/v2.1/servers/52d47b4c-e32e-4708-ade4-0be86b270c03" status: 404 len: 111 microversion: 2.1 time: 0.029418 Oct 29 01:30:19.150752 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 122/242] 10.222.0.87 () {58 vars in 1238 bytes} [Fri Oct 29 01:30:19 2021] DELETE /compute/v2.1/servers/52d47b4c-e32e-4708-ade4-0be86b270c03 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 01:30:19.156449 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-18e1d286-a437-46c0-aa03-4bdbe44cb6fc tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:19.157830 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-18e1d286-a437-46c0-aa03-4bdbe44cb6fc tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] [instance: 52d47b4c-e32e-4708-ade4-0be86b270c03] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:19.164616 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-18e1d286-a437-46c0-aa03-4bdbe44cb6fc tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:19.165060 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-18e1d286-a437-46c0-aa03-4bdbe44cb6fc tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:19.165813 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-18e1d286-a437-46c0-aa03-4bdbe44cb6fc tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:19.166249 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-18e1d286-a437-46c0-aa03-4bdbe44cb6fc tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:19.185877 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.wsgi [None req-18e1d286-a437-46c0-aa03-4bdbe44cb6fc tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] HTTP exception thrown: Instance 52d47b4c-e32e-4708-ade4-0be86b270c03 could not be found. Oct 29 01:30:19.186532 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-18e1d286-a437-46c0-aa03-4bdbe44cb6fc tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] Returning 404 to user: Instance 52d47b4c-e32e-4708-ade4-0be86b270c03 could not be found. {{(pid=116379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:30:19.187365 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-18e1d286-a437-46c0-aa03-4bdbe44cb6fc tempest-DeleteServersTestJSON-933689092 tempest-DeleteServersTestJSON-933689092-project] 10.222.0.87 "GET /compute/v2.1/servers/52d47b4c-e32e-4708-ade4-0be86b270c03" status: 404 len: 111 microversion: 2.1 time: 0.035281 Oct 29 01:30:19.188124 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 121/243] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:19 2021] GET /compute/v2.1/servers/52d47b4c-e32e-4708-ade4-0be86b270c03 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:30:19.198695 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-69266958-95ea-4c64-ab2f-65c578977b7c tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:19.199297 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-69266958-95ea-4c64-ab2f-65c578977b7c tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] [instance: df8051e5-6f5b-47e6-9659-02de55bdfee4] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:19.208685 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-69266958-95ea-4c64-ab2f-65c578977b7c tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:19.209219 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-69266958-95ea-4c64-ab2f-65c578977b7c tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:19.210071 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-69266958-95ea-4c64-ab2f-65c578977b7c tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:19.211004 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-69266958-95ea-4c64-ab2f-65c578977b7c tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:19.221297 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-f007e2d5-a018-4413-b9fb-6ca3ba1e9327 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:19.222173 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-f007e2d5-a018-4413-b9fb-6ca3ba1e9327 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 8daa36f8-7d64-4d9d-94e6-0519848d4a2c] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:19.230694 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-f007e2d5-a018-4413-b9fb-6ca3ba1e9327 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:19.238004 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-f007e2d5-a018-4413-b9fb-6ca3ba1e9327 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:19.238004 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-f007e2d5-a018-4413-b9fb-6ca3ba1e9327 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:19.238004 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-f007e2d5-a018-4413-b9fb-6ca3ba1e9327 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:19.497964 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-f007e2d5-a018-4413-b9fb-6ca3ba1e9327 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:19.509079 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-f007e2d5-a018-4413-b9fb-6ca3ba1e9327 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c" status: 200 len: 1521 microversion: 2.1 time: 0.294598 Oct 29 01:30:19.509642 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 122/244] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:19 2021] GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c => generated 1521 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:30:19.516188 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-e096e206-fb7b-4963-80e4-1a6f6aec7a37 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:19.523088 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-e096e206-fb7b-4963-80e4-1a6f6aec7a37 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:19.525492 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-e096e206-fb7b-4963-80e4-1a6f6aec7a37 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:19.525721 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-e096e206-fb7b-4963-80e4-1a6f6aec7a37 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:19.528070 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-e096e206-fb7b-4963-80e4-1a6f6aec7a37 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:19.528532 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-e096e206-fb7b-4963-80e4-1a6f6aec7a37 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:19.539995 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-69266958-95ea-4c64-ab2f-65c578977b7c tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2dbc6652b34cd3a4fc39dbabd839bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131e8f4d098e4d2ba64328c91f63c18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:19.554729 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-69266958-95ea-4c64-ab2f-65c578977b7c tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] 10.222.0.87 "GET /compute/v2.1/servers/df8051e5-6f5b-47e6-9659-02de55bdfee4" status: 200 len: 1313 microversion: 2.1 time: 0.360408 Oct 29 01:30:19.565538 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 123/245] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:19 2021] GET /compute/v2.1/servers/df8051e5-6f5b-47e6-9659-02de55bdfee4 => generated 1313 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:19.580904 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-d91b3423-a06c-4d3c-813c-575bd47fc1eb tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:19.582126 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-d91b3423-a06c-4d3c-813c-575bd47fc1eb tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:19.594168 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-d91b3423-a06c-4d3c-813c-575bd47fc1eb tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:19.598635 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-d91b3423-a06c-4d3c-813c-575bd47fc1eb tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:19.601056 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-d91b3423-a06c-4d3c-813c-575bd47fc1eb tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:19.601673 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-d91b3423-a06c-4d3c-813c-575bd47fc1eb tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:19.720109 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-e096e206-fb7b-4963-80e4-1a6f6aec7a37 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action" status: 200 len: 6099 microversion: 2.20 time: 0.206781 Oct 29 01:30:19.723882 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 123/246] 10.222.0.87 () {62 vars in 1318 bytes} [Fri Oct 29 01:30:19 2021] POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action => generated 6099 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:30:19.793619 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-d91b3423-a06c-4d3c-813c-575bd47fc1eb tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action" status: 200 len: 3067 microversion: 2.1 time: 0.218780 Oct 29 01:30:19.797553 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 124/247] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:30:19 2021] POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action => generated 3067 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:20.526761 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-ff494bcc-2ee5-4eea-a14d-7f7f7aa85d34 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:20.528596 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-ff494bcc-2ee5-4eea-a14d-7f7f7aa85d34 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 8daa36f8-7d64-4d9d-94e6-0519848d4a2c] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:20.536579 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-ff494bcc-2ee5-4eea-a14d-7f7f7aa85d34 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:20.537244 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-ff494bcc-2ee5-4eea-a14d-7f7f7aa85d34 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:20.538175 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-ff494bcc-2ee5-4eea-a14d-7f7f7aa85d34 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:20.538765 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-ff494bcc-2ee5-4eea-a14d-7f7f7aa85d34 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:20.578877 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-ba3f1614-6dab-4a2f-aef1-40cf4602e8ea tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:20.580820 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-ba3f1614-6dab-4a2f-aef1-40cf4602e8ea tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] [instance: df8051e5-6f5b-47e6-9659-02de55bdfee4] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:20.590500 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ba3f1614-6dab-4a2f-aef1-40cf4602e8ea tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:20.590500 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ba3f1614-6dab-4a2f-aef1-40cf4602e8ea tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:20.590500 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ba3f1614-6dab-4a2f-aef1-40cf4602e8ea tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:20.590500 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ba3f1614-6dab-4a2f-aef1-40cf4602e8ea tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:21.033456 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-ff494bcc-2ee5-4eea-a14d-7f7f7aa85d34 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:21.045233 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-ff494bcc-2ee5-4eea-a14d-7f7f7aa85d34 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c" status: 200 len: 1521 microversion: 2.1 time: 0.522493 Oct 29 01:30:21.050878 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 124/248] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:20 2021] GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c => generated 1521 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:21.057561 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-2869fd7f-84b0-46d5-be8b-7c8c88e6fa73 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:21.059153 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-2869fd7f-84b0-46d5-be8b-7c8c88e6fa73 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:21.060337 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-ba3f1614-6dab-4a2f-aef1-40cf4602e8ea tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2dbc6652b34cd3a4fc39dbabd839bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131e8f4d098e4d2ba64328c91f63c18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:21.069543 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-ba3f1614-6dab-4a2f-aef1-40cf4602e8ea tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] 10.222.0.87 "GET /compute/v2.1/servers/df8051e5-6f5b-47e6-9659-02de55bdfee4" status: 200 len: 1313 microversion: 2.1 time: 0.494787 Oct 29 01:30:21.071374 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-2869fd7f-84b0-46d5-be8b-7c8c88e6fa73 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:21.076528 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-2869fd7f-84b0-46d5-be8b-7c8c88e6fa73 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:21.077689 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-2869fd7f-84b0-46d5-be8b-7c8c88e6fa73 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:21.078275 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-2869fd7f-84b0-46d5-be8b-7c8c88e6fa73 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:21.080805 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 125/249] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:20 2021] GET /compute/v2.1/servers/df8051e5-6f5b-47e6-9659-02de55bdfee4 => generated 1313 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:21.096956 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-1afa5a20-912e-4f4c-8bbe-00ca7bb6799a tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:21.099600 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-1afa5a20-912e-4f4c-8bbe-00ca7bb6799a tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:21.117124 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-1afa5a20-912e-4f4c-8bbe-00ca7bb6799a tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:21.118565 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-1afa5a20-912e-4f4c-8bbe-00ca7bb6799a tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:21.119438 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-1afa5a20-912e-4f4c-8bbe-00ca7bb6799a tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:21.119892 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-1afa5a20-912e-4f4c-8bbe-00ca7bb6799a tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:21.208325 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-2869fd7f-84b0-46d5-be8b-7c8c88e6fa73 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action" status: 200 len: 9366 microversion: 2.20 time: 0.155644 Oct 29 01:30:21.210042 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 125/250] 10.222.0.87 () {62 vars in 1318 bytes} [Fri Oct 29 01:30:21 2021] POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action => generated 9366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:30:21.244396 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-1afa5a20-912e-4f4c-8bbe-00ca7bb6799a tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action" status: 200 len: 8879 microversion: 2.1 time: 0.162026 Oct 29 01:30:21.252045 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 126/251] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:30:21 2021] POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action => generated 8879 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:22.066991 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-16c458aa-03eb-4e30-bb46-bd60dd2cdd9e tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:22.067765 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-16c458aa-03eb-4e30-bb46-bd60dd2cdd9e tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 8daa36f8-7d64-4d9d-94e6-0519848d4a2c] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:22.081150 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-16c458aa-03eb-4e30-bb46-bd60dd2cdd9e tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:22.081980 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-16c458aa-03eb-4e30-bb46-bd60dd2cdd9e tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:22.088917 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-16c458aa-03eb-4e30-bb46-bd60dd2cdd9e tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:22.088917 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-16c458aa-03eb-4e30-bb46-bd60dd2cdd9e tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:22.097534 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-657acd29-3e27-4288-9671-0fb0e5d3cabd tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:22.098246 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-657acd29-3e27-4288-9671-0fb0e5d3cabd tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] [instance: df8051e5-6f5b-47e6-9659-02de55bdfee4] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:22.115916 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-657acd29-3e27-4288-9671-0fb0e5d3cabd tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:22.119368 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-657acd29-3e27-4288-9671-0fb0e5d3cabd tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:22.119368 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-657acd29-3e27-4288-9671-0fb0e5d3cabd tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:22.119368 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-657acd29-3e27-4288-9671-0fb0e5d3cabd tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:22.354194 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-16c458aa-03eb-4e30-bb46-bd60dd2cdd9e tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:22.363564 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-16c458aa-03eb-4e30-bb46-bd60dd2cdd9e tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c" status: 200 len: 1521 microversion: 2.1 time: 0.301211 Oct 29 01:30:22.388580 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 126/252] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:22 2021] GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c => generated 1521 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:22.388688 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-657acd29-3e27-4288-9671-0fb0e5d3cabd tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2dbc6652b34cd3a4fc39dbabd839bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131e8f4d098e4d2ba64328c91f63c18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:22.388783 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-a8eb702a-02c1-486f-a1b3-72408f401b60 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:22.388783 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-a8eb702a-02c1-486f-a1b3-72408f401b60 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:22.388918 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-657acd29-3e27-4288-9671-0fb0e5d3cabd tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] 10.222.0.87 "GET /compute/v2.1/servers/df8051e5-6f5b-47e6-9659-02de55bdfee4" status: 200 len: 1313 microversion: 2.1 time: 0.298311 Oct 29 01:30:22.388918 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 127/253] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:22 2021] GET /compute/v2.1/servers/df8051e5-6f5b-47e6-9659-02de55bdfee4 => generated 1313 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:22.389252 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-a8eb702a-02c1-486f-a1b3-72408f401b60 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:22.389252 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-a8eb702a-02c1-486f-a1b3-72408f401b60 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:22.389252 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-a8eb702a-02c1-486f-a1b3-72408f401b60 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:22.389252 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-a8eb702a-02c1-486f-a1b3-72408f401b60 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:22.389516 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-2b0f27ba-f03b-4a6c-ba39-dade3ceac942 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:22.389516 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-2b0f27ba-f03b-4a6c-ba39-dade3ceac942 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:22.394509 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-2b0f27ba-f03b-4a6c-ba39-dade3ceac942 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:22.394955 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-2b0f27ba-f03b-4a6c-ba39-dade3ceac942 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:22.395775 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-2b0f27ba-f03b-4a6c-ba39-dade3ceac942 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:22.396212 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-2b0f27ba-f03b-4a6c-ba39-dade3ceac942 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:22.522271 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-a8eb702a-02c1-486f-a1b3-72408f401b60 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action" status: 200 len: 12239 microversion: 2.20 time: 0.152293 Oct 29 01:30:22.523117 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 127/254] 10.222.0.87 () {62 vars in 1318 bytes} [Fri Oct 29 01:30:22 2021] POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action => generated 12239 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:30:22.549682 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-2b0f27ba-f03b-4a6c-ba39-dade3ceac942 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action" status: 200 len: 11629 microversion: 2.1 time: 0.165611 Oct 29 01:30:22.550677 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 128/255] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:30:22 2021] POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action => generated 11629 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:30:23.381421 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-9b168666-4a5d-4dc9-8f4e-35afb3cbe43a tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:23.382094 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-9b168666-4a5d-4dc9-8f4e-35afb3cbe43a tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 8daa36f8-7d64-4d9d-94e6-0519848d4a2c] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:23.388885 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-9b168666-4a5d-4dc9-8f4e-35afb3cbe43a tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:23.389326 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-9b168666-4a5d-4dc9-8f4e-35afb3cbe43a tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:23.390085 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-9b168666-4a5d-4dc9-8f4e-35afb3cbe43a tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:23.390508 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-9b168666-4a5d-4dc9-8f4e-35afb3cbe43a tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:23.402121 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-ee859a8c-a601-45ce-bc71-ff81741b576c tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:23.402717 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-ee859a8c-a601-45ce-bc71-ff81741b576c tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] [instance: df8051e5-6f5b-47e6-9659-02de55bdfee4] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:23.409895 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ee859a8c-a601-45ce-bc71-ff81741b576c tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:23.410329 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ee859a8c-a601-45ce-bc71-ff81741b576c tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:23.411091 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ee859a8c-a601-45ce-bc71-ff81741b576c tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:23.411700 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ee859a8c-a601-45ce-bc71-ff81741b576c tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:23.598250 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-9b168666-4a5d-4dc9-8f4e-35afb3cbe43a tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:23.616398 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-9b168666-4a5d-4dc9-8f4e-35afb3cbe43a tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c" status: 200 len: 1521 microversion: 2.1 time: 0.238958 Oct 29 01:30:23.631163 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 128/256] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:23 2021] GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c => generated 1521 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:30:23.631315 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-ee859a8c-a601-45ce-bc71-ff81741b576c tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2dbc6652b34cd3a4fc39dbabd839bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131e8f4d098e4d2ba64328c91f63c18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:23.635460 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-4686ff1d-b118-4657-aae2-9b2782d01949 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:23.635814 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-ee859a8c-a601-45ce-bc71-ff81741b576c tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] 10.222.0.87 "GET /compute/v2.1/servers/df8051e5-6f5b-47e6-9659-02de55bdfee4" status: 200 len: 1313 microversion: 2.1 time: 0.237465 Oct 29 01:30:23.636536 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-4686ff1d-b118-4657-aae2-9b2782d01949 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:23.637583 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 129/257] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:23 2021] GET /compute/v2.1/servers/df8051e5-6f5b-47e6-9659-02de55bdfee4 => generated 1313 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:30:23.643069 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-0c554f67-8fb1-4ad5-a4b7-45234b359bda tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:23.644484 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-0c554f67-8fb1-4ad5-a4b7-45234b359bda tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:23.650233 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-4686ff1d-b118-4657-aae2-9b2782d01949 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:23.650711 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-4686ff1d-b118-4657-aae2-9b2782d01949 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:23.651254 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-0c554f67-8fb1-4ad5-a4b7-45234b359bda tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:23.651892 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-4686ff1d-b118-4657-aae2-9b2782d01949 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:23.652007 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-4686ff1d-b118-4657-aae2-9b2782d01949 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:23.652715 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-0c554f67-8fb1-4ad5-a4b7-45234b359bda tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:23.653703 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-0c554f67-8fb1-4ad5-a4b7-45234b359bda tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:23.654354 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-0c554f67-8fb1-4ad5-a4b7-45234b359bda tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:23.794656 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-4686ff1d-b118-4657-aae2-9b2782d01949 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action" status: 200 len: 15064 microversion: 2.20 time: 0.170361 Oct 29 01:30:23.795583 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 129/258] 10.222.0.87 () {62 vars in 1318 bytes} [Fri Oct 29 01:30:23 2021] POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action => generated 15064 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:30:23.819409 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [req-bbc524d7-6bfe-4d3b-8ed6-78096e22170d req-c5a1bb67-4565-44fb-8185-dbe7a3f5358f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df8051e5-6f5b-47e6-9659-02de55bdfee4", "name": "network-vif-plugged", "status": "completed", "tag": "e2181a7c-4599-4336-b587-33fe8cb2e717"}]} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:23.819964 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-0c554f67-8fb1-4ad5-a4b7-45234b359bda tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action" status: 200 len: 15064 microversion: 2.1 time: 0.180948 Oct 29 01:30:23.820608 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 130/259] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:30:23 2021] POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action => generated 15064 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:30:23.822216 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:30:23.822216 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: warnings.warn(msg) Oct 29 01:30:23.831777 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [req-bbc524d7-6bfe-4d3b-8ed6-78096e22170d req-c5a1bb67-4565-44fb-8185-dbe7a3f5358f service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:23.832303 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [req-bbc524d7-6bfe-4d3b-8ed6-78096e22170d req-c5a1bb67-4565-44fb-8185-dbe7a3f5358f service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:23.843948 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.compute.server_external_events [req-bbc524d7-6bfe-4d3b-8ed6-78096e22170d req-c5a1bb67-4565-44fb-8185-dbe7a3f5358f service nova] Creating event network-vif-plugged:e2181a7c-4599-4336-b587-33fe8cb2e717 for instance df8051e5-6f5b-47e6-9659-02de55bdfee4 on hv-cinder-81398 Oct 29 01:30:23.851776 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [req-bbc524d7-6bfe-4d3b-8ed6-78096e22170d req-c5a1bb67-4565-44fb-8185-dbe7a3f5358f service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034364 Oct 29 01:30:23.851776 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 130/260] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Oct 29 01:30:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:30:24.638680 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-a97b0046-031a-452e-be2c-164a4912d71d tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:24.639609 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-a97b0046-031a-452e-be2c-164a4912d71d tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 8daa36f8-7d64-4d9d-94e6-0519848d4a2c] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:24.648086 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a97b0046-031a-452e-be2c-164a4912d71d tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:24.648856 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a97b0046-031a-452e-be2c-164a4912d71d tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:24.651054 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a97b0046-031a-452e-be2c-164a4912d71d tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:24.651879 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a97b0046-031a-452e-be2c-164a4912d71d tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:24.655646 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-63d7cff8-fca7-4b3b-91c9-f23af77bb789 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:24.657798 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-63d7cff8-fca7-4b3b-91c9-f23af77bb789 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] [instance: df8051e5-6f5b-47e6-9659-02de55bdfee4] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:24.673222 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-63d7cff8-fca7-4b3b-91c9-f23af77bb789 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:24.673998 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-63d7cff8-fca7-4b3b-91c9-f23af77bb789 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:24.677008 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-63d7cff8-fca7-4b3b-91c9-f23af77bb789 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:24.678699 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-63d7cff8-fca7-4b3b-91c9-f23af77bb789 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:24.893444 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-a97b0046-031a-452e-be2c-164a4912d71d tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:24.905041 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-a97b0046-031a-452e-be2c-164a4912d71d tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c" status: 200 len: 1521 microversion: 2.1 time: 0.270336 Oct 29 01:30:24.905625 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 131/261] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:24 2021] GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c => generated 1521 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:24.915581 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-c55605ac-e56d-451d-aabc-a8ec08fd6205 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:24.916549 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-c55605ac-e56d-451d-aabc-a8ec08fd6205 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:24.924031 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c55605ac-e56d-451d-aabc-a8ec08fd6205 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:24.924483 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c55605ac-e56d-451d-aabc-a8ec08fd6205 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:24.925259 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c55605ac-e56d-451d-aabc-a8ec08fd6205 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:24.925690 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c55605ac-e56d-451d-aabc-a8ec08fd6205 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:24.929490 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-63d7cff8-fca7-4b3b-91c9-f23af77bb789 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2dbc6652b34cd3a4fc39dbabd839bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131e8f4d098e4d2ba64328c91f63c18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:24.936794 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-63d7cff8-fca7-4b3b-91c9-f23af77bb789 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] 10.222.0.87 "GET /compute/v2.1/servers/df8051e5-6f5b-47e6-9659-02de55bdfee4" status: 200 len: 1313 microversion: 2.1 time: 0.286305 Oct 29 01:30:24.937364 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 131/262] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:24 2021] GET /compute/v2.1/servers/df8051e5-6f5b-47e6-9659-02de55bdfee4 => generated 1313 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:30:24.942339 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-56522b79-a1a0-46dd-894e-c6b518968477 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:24.947261 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-56522b79-a1a0-46dd-894e-c6b518968477 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:24.965638 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-56522b79-a1a0-46dd-894e-c6b518968477 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:24.966782 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-56522b79-a1a0-46dd-894e-c6b518968477 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:24.967589 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-56522b79-a1a0-46dd-894e-c6b518968477 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:24.968107 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-56522b79-a1a0-46dd-894e-c6b518968477 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:25.048412 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-c55605ac-e56d-451d-aabc-a8ec08fd6205 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action" status: 200 len: 17629 microversion: 2.20 time: 0.141243 Oct 29 01:30:25.050139 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 132/263] 10.222.0.87 () {62 vars in 1318 bytes} [Fri Oct 29 01:30:24 2021] POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action => generated 17629 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:30:25.107327 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-56522b79-a1a0-46dd-894e-c6b518968477 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action" status: 200 len: 17629 microversion: 2.1 time: 0.168720 Oct 29 01:30:25.108141 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 132/264] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:30:24 2021] POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action => generated 17629 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:30:25.923811 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-b3609928-ec82-4347-8e00-c529448b4559 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:25.924920 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-b3609928-ec82-4347-8e00-c529448b4559 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 8daa36f8-7d64-4d9d-94e6-0519848d4a2c] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:25.931280 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-b3609928-ec82-4347-8e00-c529448b4559 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:25.934744 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-b3609928-ec82-4347-8e00-c529448b4559 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:25.934744 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-b3609928-ec82-4347-8e00-c529448b4559 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:25.934744 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-b3609928-ec82-4347-8e00-c529448b4559 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:25.957979 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-59936e33-4c55-4488-877c-1f1ec6cf942d tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:25.958771 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-59936e33-4c55-4488-877c-1f1ec6cf942d tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] [instance: df8051e5-6f5b-47e6-9659-02de55bdfee4] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:25.967252 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-59936e33-4c55-4488-877c-1f1ec6cf942d tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:25.967704 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-59936e33-4c55-4488-877c-1f1ec6cf942d tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:25.968512 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-59936e33-4c55-4488-877c-1f1ec6cf942d tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:25.968944 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-59936e33-4c55-4488-877c-1f1ec6cf942d tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:26.191554 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-59936e33-4c55-4488-877c-1f1ec6cf942d tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2dbc6652b34cd3a4fc39dbabd839bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131e8f4d098e4d2ba64328c91f63c18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:26.202113 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-b3609928-ec82-4347-8e00-c529448b4559 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:26.202225 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-59936e33-4c55-4488-877c-1f1ec6cf942d tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] 10.222.0.87 "GET /compute/v2.1/servers/df8051e5-6f5b-47e6-9659-02de55bdfee4" status: 200 len: 1313 microversion: 2.1 time: 0.248212 Oct 29 01:30:26.203404 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 133/265] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:25 2021] GET /compute/v2.1/servers/df8051e5-6f5b-47e6-9659-02de55bdfee4 => generated 1313 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:30:26.209630 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-f6b144c8-fcbd-467d-86b9-4a578c0812c0 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:26.210794 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-f6b144c8-fcbd-467d-86b9-4a578c0812c0 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:26.226564 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-b3609928-ec82-4347-8e00-c529448b4559 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c" status: 200 len: 1521 microversion: 2.1 time: 0.306816 Oct 29 01:30:26.228473 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 133/266] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:25 2021] GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c => generated 1521 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:26.237961 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-0d82853c-d2dd-4610-b5b5-38029d306d0a tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:26.239461 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-0d82853c-d2dd-4610-b5b5-38029d306d0a tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:26.244477 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-f6b144c8-fcbd-467d-86b9-4a578c0812c0 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:26.244976 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-f6b144c8-fcbd-467d-86b9-4a578c0812c0 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:26.245751 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-f6b144c8-fcbd-467d-86b9-4a578c0812c0 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:26.246365 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-f6b144c8-fcbd-467d-86b9-4a578c0812c0 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:26.248559 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-0d82853c-d2dd-4610-b5b5-38029d306d0a tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:26.249399 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-0d82853c-d2dd-4610-b5b5-38029d306d0a tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:26.253494 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-0d82853c-d2dd-4610-b5b5-38029d306d0a tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:26.257478 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-0d82853c-d2dd-4610-b5b5-38029d306d0a tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:26.362123 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-f6b144c8-fcbd-467d-86b9-4a578c0812c0 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action" status: 200 len: 17629 microversion: 2.20 time: 0.156743 Oct 29 01:30:26.365781 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 134/267] 10.222.0.87 () {62 vars in 1318 bytes} [Fri Oct 29 01:30:26 2021] POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action => generated 17629 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:30:26.365907 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-0d82853c-d2dd-4610-b5b5-38029d306d0a tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action" status: 200 len: 17629 microversion: 2.1 time: 0.135160 Oct 29 01:30:26.366390 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 134/268] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:30:26 2021] POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action => generated 17629 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:30:27.222990 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-ae185113-5d25-442c-b736-3cb37530bff5 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:27.223667 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-ae185113-5d25-442c-b736-3cb37530bff5 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] [instance: df8051e5-6f5b-47e6-9659-02de55bdfee4] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:27.231541 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-ae185113-5d25-442c-b736-3cb37530bff5 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:27.232023 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-ae185113-5d25-442c-b736-3cb37530bff5 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:27.232812 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-ae185113-5d25-442c-b736-3cb37530bff5 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:27.233243 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-ae185113-5d25-442c-b736-3cb37530bff5 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:27.249391 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-f83a87fa-f8ea-4e82-8607-55dfac240b3a tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:27.250088 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-f83a87fa-f8ea-4e82-8607-55dfac240b3a tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 8daa36f8-7d64-4d9d-94e6-0519848d4a2c] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:27.265507 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-f83a87fa-f8ea-4e82-8607-55dfac240b3a tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:27.267339 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-f83a87fa-f8ea-4e82-8607-55dfac240b3a tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:27.268889 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-f83a87fa-f8ea-4e82-8607-55dfac240b3a tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:27.269530 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-f83a87fa-f8ea-4e82-8607-55dfac240b3a tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:27.454650 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-ae185113-5d25-442c-b736-3cb37530bff5 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2dbc6652b34cd3a4fc39dbabd839bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131e8f4d098e4d2ba64328c91f63c18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:27.468141 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-ae185113-5d25-442c-b736-3cb37530bff5 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] 10.222.0.87 "GET /compute/v2.1/servers/df8051e5-6f5b-47e6-9659-02de55bdfee4" status: 200 len: 1495 microversion: 2.1 time: 0.249144 Oct 29 01:30:27.469295 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 135/269] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:27 2021] GET /compute/v2.1/servers/df8051e5-6f5b-47e6-9659-02de55bdfee4 => generated 1495 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:27.475978 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-ebe58321-2e02-4875-a380-949de72288b1 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:27.480781 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-ebe58321-2e02-4875-a380-949de72288b1 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:27.482867 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-ebe58321-2e02-4875-a380-949de72288b1 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:27.483420 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-ebe58321-2e02-4875-a380-949de72288b1 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:27.484325 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-ebe58321-2e02-4875-a380-949de72288b1 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:27.485112 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-ebe58321-2e02-4875-a380-949de72288b1 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:27.488601 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-f83a87fa-f8ea-4e82-8607-55dfac240b3a tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:27.498133 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-f83a87fa-f8ea-4e82-8607-55dfac240b3a tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c" status: 200 len: 1521 microversion: 2.1 time: 0.254759 Oct 29 01:30:27.498694 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 135/270] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:27 2021] GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c => generated 1521 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:27.507050 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-9aa386da-e67f-47d9-9f59-ab03f587832c tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:27.508362 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-9aa386da-e67f-47d9-9f59-ab03f587832c tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:27.515747 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-9aa386da-e67f-47d9-9f59-ab03f587832c tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:27.517115 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-9aa386da-e67f-47d9-9f59-ab03f587832c tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:27.518142 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-9aa386da-e67f-47d9-9f59-ab03f587832c tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:27.518711 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-9aa386da-e67f-47d9-9f59-ab03f587832c tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:27.617132 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-ebe58321-2e02-4875-a380-949de72288b1 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action" status: 200 len: 19342 microversion: 2.20 time: 0.140115 Oct 29 01:30:27.617132 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 136/271] 10.222.0.87 () {62 vars in 1318 bytes} [Fri Oct 29 01:30:27 2021] POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action => generated 19342 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:30:27.645613 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-9aa386da-e67f-47d9-9f59-ab03f587832c tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action" status: 200 len: 19342 microversion: 2.1 time: 0.143331 Oct 29 01:30:27.647827 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 136/272] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:30:27 2021] POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action => generated 19342 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:30:28.515772 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-0cb808fc-f1c5-4922-95c1-1a847119afe5 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:28.516761 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-0cb808fc-f1c5-4922-95c1-1a847119afe5 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 8daa36f8-7d64-4d9d-94e6-0519848d4a2c] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:28.524195 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-0cb808fc-f1c5-4922-95c1-1a847119afe5 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:28.524715 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-0cb808fc-f1c5-4922-95c1-1a847119afe5 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:28.526001 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-0cb808fc-f1c5-4922-95c1-1a847119afe5 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:28.526556 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-0cb808fc-f1c5-4922-95c1-1a847119afe5 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:28.602739 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-c8762763-3a86-46d3-91d0-2a6f91f09852 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:28.603320 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-c8762763-3a86-46d3-91d0-2a6f91f09852 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] [instance: df8051e5-6f5b-47e6-9659-02de55bdfee4] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:28.611817 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c8762763-3a86-46d3-91d0-2a6f91f09852 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:28.612269 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c8762763-3a86-46d3-91d0-2a6f91f09852 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:28.613241 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c8762763-3a86-46d3-91d0-2a6f91f09852 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:28.613672 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c8762763-3a86-46d3-91d0-2a6f91f09852 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:28.644973 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-c8762763-3a86-46d3-91d0-2a6f91f09852 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] [instance: df8051e5-6f5b-47e6-9659-02de55bdfee4] Going to try to terminate instance {{(pid=116378) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 29 01:30:28.758845 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-0cb808fc-f1c5-4922-95c1-1a847119afe5 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:28.766647 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-0cb808fc-f1c5-4922-95c1-1a847119afe5 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c" status: 200 len: 1521 microversion: 2.1 time: 0.254912 Oct 29 01:30:28.767298 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 137/273] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:28 2021] GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c => generated 1521 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:28.776991 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-d2324ce2-1a19-4d51-9726-5b0a1aa86631 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:28.776991 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-d2324ce2-1a19-4d51-9726-5b0a1aa86631 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:28.779035 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d2324ce2-1a19-4d51-9726-5b0a1aa86631 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:28.780079 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d2324ce2-1a19-4d51-9726-5b0a1aa86631 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:28.780300 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d2324ce2-1a19-4d51-9726-5b0a1aa86631 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:28.780758 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d2324ce2-1a19-4d51-9726-5b0a1aa86631 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:28.898398 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-d2324ce2-1a19-4d51-9726-5b0a1aa86631 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action" status: 200 len: 21784 microversion: 2.20 time: 0.129761 Oct 29 01:30:28.899472 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 138/274] 10.222.0.87 () {62 vars in 1318 bytes} [Fri Oct 29 01:30:28 2021] POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action => generated 21784 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:30:28.916829 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-48e7cba6-d69d-45b2-8a81-e0c7140b919f tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:28.919370 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-48e7cba6-d69d-45b2-8a81-e0c7140b919f tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:28.928973 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-48e7cba6-d69d-45b2-8a81-e0c7140b919f tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:28.928973 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-48e7cba6-d69d-45b2-8a81-e0c7140b919f tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:28.929900 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-48e7cba6-d69d-45b2-8a81-e0c7140b919f tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:28.930330 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-48e7cba6-d69d-45b2-8a81-e0c7140b919f tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:29.036640 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-48e7cba6-d69d-45b2-8a81-e0c7140b919f tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action" status: 200 len: 21623 microversion: 2.1 time: 0.135476 Oct 29 01:30:29.037390 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 139/275] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:30:28 2021] POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action => generated 21623 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:30:29.117398 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-c8762763-3a86-46d3-91d0-2a6f91f09852 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] 10.222.0.87 "DELETE /compute/v2.1/servers/df8051e5-6f5b-47e6-9659-02de55bdfee4" status: 204 len: 0 microversion: 2.1 time: 0.518687 Oct 29 01:30:29.118322 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 137/276] 10.222.0.87 () {58 vars in 1238 bytes} [Fri Oct 29 01:30:28 2021] DELETE /compute/v2.1/servers/df8051e5-6f5b-47e6-9659-02de55bdfee4 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:30:29.132869 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-485bcc8c-4c0e-4d35-bd03-49da49a25434 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:29.133555 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-485bcc8c-4c0e-4d35-bd03-49da49a25434 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] [instance: df8051e5-6f5b-47e6-9659-02de55bdfee4] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:29.142592 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-485bcc8c-4c0e-4d35-bd03-49da49a25434 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:29.143319 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-485bcc8c-4c0e-4d35-bd03-49da49a25434 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:29.144610 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-485bcc8c-4c0e-4d35-bd03-49da49a25434 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:29.145314 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-485bcc8c-4c0e-4d35-bd03-49da49a25434 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:29.285849 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-485bcc8c-4c0e-4d35-bd03-49da49a25434 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2dbc6652b34cd3a4fc39dbabd839bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131e8f4d098e4d2ba64328c91f63c18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:29.298452 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-485bcc8c-4c0e-4d35-bd03-49da49a25434 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] 10.222.0.87 "GET /compute/v2.1/servers/df8051e5-6f5b-47e6-9659-02de55bdfee4" status: 200 len: 1501 microversion: 2.1 time: 0.172172 Oct 29 01:30:29.299118 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 140/277] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:29 2021] GET /compute/v2.1/servers/df8051e5-6f5b-47e6-9659-02de55bdfee4 => generated 1501 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:29.785490 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-8af0a575-a9da-488e-9925-167d17f703fb tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:29.786287 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-8af0a575-a9da-488e-9925-167d17f703fb tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 8daa36f8-7d64-4d9d-94e6-0519848d4a2c] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:29.792916 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-8af0a575-a9da-488e-9925-167d17f703fb tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:29.793521 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-8af0a575-a9da-488e-9925-167d17f703fb tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:29.794448 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-8af0a575-a9da-488e-9925-167d17f703fb tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:29.794977 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-8af0a575-a9da-488e-9925-167d17f703fb tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:29.910499 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-da66fa4c-8838-45be-a72a-ee844724049d tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:29.912079 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-da66fa4c-8838-45be-a72a-ee844724049d tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:29.927062 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-da66fa4c-8838-45be-a72a-ee844724049d tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:29.927513 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-da66fa4c-8838-45be-a72a-ee844724049d tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:29.932752 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-da66fa4c-8838-45be-a72a-ee844724049d tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:29.933407 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-da66fa4c-8838-45be-a72a-ee844724049d tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:29.965168 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-8af0a575-a9da-488e-9925-167d17f703fb tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:29.975022 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-8af0a575-a9da-488e-9925-167d17f703fb tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c" status: 200 len: 1521 microversion: 2.1 time: 0.194317 Oct 29 01:30:29.975597 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 138/278] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:29 2021] GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:30:30.051140 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-a5381922-e36f-4048-97f1-424f497d7582 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:30.052243 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-a5381922-e36f-4048-97f1-424f497d7582 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:30.061126 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a5381922-e36f-4048-97f1-424f497d7582 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:30.061526 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a5381922-e36f-4048-97f1-424f497d7582 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:30.062300 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a5381922-e36f-4048-97f1-424f497d7582 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:30.062727 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a5381922-e36f-4048-97f1-424f497d7582 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:30.076899 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-da66fa4c-8838-45be-a72a-ee844724049d tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action" status: 200 len: 22972 microversion: 2.20 time: 0.169680 Oct 29 01:30:30.079347 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 141/279] 10.222.0.87 () {62 vars in 1318 bytes} [Fri Oct 29 01:30:29 2021] POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action => generated 22972 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 29 01:30:30.185415 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-a5381922-e36f-4048-97f1-424f497d7582 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action" status: 200 len: 22978 microversion: 2.1 time: 0.138453 Oct 29 01:30:30.186368 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 139/280] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:30:30 2021] POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action => generated 22978 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:30:30.316647 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-642e91cc-1069-4f31-a90e-4f8fbe01bb7e tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:30.317450 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-642e91cc-1069-4f31-a90e-4f8fbe01bb7e tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] [instance: df8051e5-6f5b-47e6-9659-02de55bdfee4] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:30.325435 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-642e91cc-1069-4f31-a90e-4f8fbe01bb7e tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:30.326324 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-642e91cc-1069-4f31-a90e-4f8fbe01bb7e tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:30.333410 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-642e91cc-1069-4f31-a90e-4f8fbe01bb7e tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:30.334145 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-642e91cc-1069-4f31-a90e-4f8fbe01bb7e tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:30.481989 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-642e91cc-1069-4f31-a90e-4f8fbe01bb7e tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2dbc6652b34cd3a4fc39dbabd839bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131e8f4d098e4d2ba64328c91f63c18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:30.493497 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-642e91cc-1069-4f31-a90e-4f8fbe01bb7e tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] 10.222.0.87 "GET /compute/v2.1/servers/df8051e5-6f5b-47e6-9659-02de55bdfee4" status: 200 len: 1501 microversion: 2.1 time: 0.182220 Oct 29 01:30:30.494237 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 142/281] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:30 2021] GET /compute/v2.1/servers/df8051e5-6f5b-47e6-9659-02de55bdfee4 => generated 1501 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:30.992359 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-2c19f9a0-f1a2-4170-a331-294ff9e6a898 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:30.993066 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-2c19f9a0-f1a2-4170-a331-294ff9e6a898 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 8daa36f8-7d64-4d9d-94e6-0519848d4a2c] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:31.000320 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-2c19f9a0-f1a2-4170-a331-294ff9e6a898 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:31.003368 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-2c19f9a0-f1a2-4170-a331-294ff9e6a898 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:31.003368 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-2c19f9a0-f1a2-4170-a331-294ff9e6a898 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:31.003368 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-2c19f9a0-f1a2-4170-a331-294ff9e6a898 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:31.099793 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-2ce1bbe1-7f05-4a5b-9f59-23753a5f5813 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:31.100740 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-2ce1bbe1-7f05-4a5b-9f59-23753a5f5813 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:31.119061 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-2ce1bbe1-7f05-4a5b-9f59-23753a5f5813 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:31.119510 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-2ce1bbe1-7f05-4a5b-9f59-23753a5f5813 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:31.121272 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-2ce1bbe1-7f05-4a5b-9f59-23753a5f5813 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:31.121871 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-2ce1bbe1-7f05-4a5b-9f59-23753a5f5813 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:31.186304 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-2c19f9a0-f1a2-4170-a331-294ff9e6a898 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:31.206222 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-2c19f9a0-f1a2-4170-a331-294ff9e6a898 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c" status: 200 len: 1521 microversion: 2.1 time: 0.206128 Oct 29 01:30:31.206222 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 140/282] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:30 2021] GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:31.206222 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-e7a8e37b-a1ee-465a-ada1-a0be00468ef0 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:31.206222 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-e7a8e37b-a1ee-465a-ada1-a0be00468ef0 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:31.216410 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-e7a8e37b-a1ee-465a-ada1-a0be00468ef0 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:31.217018 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-e7a8e37b-a1ee-465a-ada1-a0be00468ef0 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:31.217891 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-e7a8e37b-a1ee-465a-ada1-a0be00468ef0 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:31.218559 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-e7a8e37b-a1ee-465a-ada1-a0be00468ef0 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:31.247005 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-2ce1bbe1-7f05-4a5b-9f59-23753a5f5813 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action" status: 200 len: 23228 microversion: 2.20 time: 0.160706 Oct 29 01:30:31.247688 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 143/283] 10.222.0.87 () {62 vars in 1318 bytes} [Fri Oct 29 01:30:31 2021] POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action => generated 23228 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:30:31.320609 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-e7a8e37b-a1ee-465a-ada1-a0be00468ef0 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action" status: 200 len: 23233 microversion: 2.1 time: 0.115855 Oct 29 01:30:31.320609 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 141/284] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:30:31 2021] POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action => generated 23233 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:30:31.517048 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-d9494910-6f26-41a4-bdbb-9b00f9e329ad tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:31.517947 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-d9494910-6f26-41a4-bdbb-9b00f9e329ad tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] [instance: df8051e5-6f5b-47e6-9659-02de55bdfee4] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:31.527573 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d9494910-6f26-41a4-bdbb-9b00f9e329ad tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:31.529870 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d9494910-6f26-41a4-bdbb-9b00f9e329ad tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:31.531862 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d9494910-6f26-41a4-bdbb-9b00f9e329ad tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:31.532309 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d9494910-6f26-41a4-bdbb-9b00f9e329ad tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:31.789035 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-d9494910-6f26-41a4-bdbb-9b00f9e329ad tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2dbc6652b34cd3a4fc39dbabd839bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131e8f4d098e4d2ba64328c91f63c18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:31.801083 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-d9494910-6f26-41a4-bdbb-9b00f9e329ad tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] 10.222.0.87 "GET /compute/v2.1/servers/df8051e5-6f5b-47e6-9659-02de55bdfee4" status: 200 len: 1501 microversion: 2.1 time: 0.287478 Oct 29 01:30:31.801083 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 144/285] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:31 2021] GET /compute/v2.1/servers/df8051e5-6f5b-47e6-9659-02de55bdfee4 => generated 1501 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:32.214686 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [req-d09a5f43-7fb8-437b-86f0-2a29a7bcaa45 req-b11526b2-ce67-4e53-8d7c-1b6284648fea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df8051e5-6f5b-47e6-9659-02de55bdfee4", "name": "network-vif-deleted", "tag": "e2181a7c-4599-4336-b587-33fe8cb2e717"}]} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:32.216434 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:30:32.216434 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: warnings.warn(msg) Oct 29 01:30:32.223945 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-e3f5cf1f-6d84-4b78-990c-57ce56fd1a4f tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:32.225151 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-e3f5cf1f-6d84-4b78-990c-57ce56fd1a4f tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 8daa36f8-7d64-4d9d-94e6-0519848d4a2c] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:32.225828 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [req-d09a5f43-7fb8-437b-86f0-2a29a7bcaa45 req-b11526b2-ce67-4e53-8d7c-1b6284648fea service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:32.226330 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [req-d09a5f43-7fb8-437b-86f0-2a29a7bcaa45 req-b11526b2-ce67-4e53-8d7c-1b6284648fea service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:32.235879 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-e3f5cf1f-6d84-4b78-990c-57ce56fd1a4f tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:32.241962 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-e3f5cf1f-6d84-4b78-990c-57ce56fd1a4f tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:32.241962 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-e3f5cf1f-6d84-4b78-990c-57ce56fd1a4f tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:32.241962 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-e3f5cf1f-6d84-4b78-990c-57ce56fd1a4f tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:32.242262 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.compute.server_external_events [req-d09a5f43-7fb8-437b-86f0-2a29a7bcaa45 req-b11526b2-ce67-4e53-8d7c-1b6284648fea service nova] Creating event network-vif-deleted:e2181a7c-4599-4336-b587-33fe8cb2e717 for instance df8051e5-6f5b-47e6-9659-02de55bdfee4 on hv-cinder-81398 Oct 29 01:30:32.244406 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [req-d09a5f43-7fb8-437b-86f0-2a29a7bcaa45 req-b11526b2-ce67-4e53-8d7c-1b6284648fea service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033582 Oct 29 01:30:32.244998 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 142/286] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Oct 29 01:30:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:30:32.274211 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-541fb068-18b7-4212-a222-e8c82efb4132 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:32.275568 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-541fb068-18b7-4212-a222-e8c82efb4132 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:32.283070 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-541fb068-18b7-4212-a222-e8c82efb4132 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:32.284390 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-541fb068-18b7-4212-a222-e8c82efb4132 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:32.285164 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-541fb068-18b7-4212-a222-e8c82efb4132 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:32.285744 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-541fb068-18b7-4212-a222-e8c82efb4132 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:32.394937 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-e3f5cf1f-6d84-4b78-990c-57ce56fd1a4f tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:32.402987 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-e3f5cf1f-6d84-4b78-990c-57ce56fd1a4f tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c" status: 200 len: 1521 microversion: 2.1 time: 0.185328 Oct 29 01:30:32.403619 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 145/287] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:32 2021] GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:32.408724 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-3dc318c4-fc2f-4bd5-852e-a7b35fe7676d tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:32.409631 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-3dc318c4-fc2f-4bd5-852e-a7b35fe7676d tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:32.418146 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-3dc318c4-fc2f-4bd5-852e-a7b35fe7676d tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:32.418700 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-3dc318c4-fc2f-4bd5-852e-a7b35fe7676d tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:32.419483 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-3dc318c4-fc2f-4bd5-852e-a7b35fe7676d tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:32.419948 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-3dc318c4-fc2f-4bd5-852e-a7b35fe7676d tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:32.594831 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-541fb068-18b7-4212-a222-e8c82efb4132 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action" status: 200 len: 24590 microversion: 2.20 time: 0.326865 Oct 29 01:30:32.595474 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 143/288] 10.222.0.87 () {62 vars in 1318 bytes} [Fri Oct 29 01:30:32 2021] POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action => generated 24590 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:30:32.620816 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-3dc318c4-fc2f-4bd5-852e-a7b35fe7676d tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action" status: 200 len: 24625 microversion: 2.1 time: 0.215900 Oct 29 01:30:32.621541 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 146/289] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:30:32 2021] POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action => generated 24625 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:30:32.824869 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-ffd9dff3-daf6-406e-a3de-294b5fb568e8 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:32.824869 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-ffd9dff3-daf6-406e-a3de-294b5fb568e8 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] [instance: df8051e5-6f5b-47e6-9659-02de55bdfee4] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:32.826772 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ffd9dff3-daf6-406e-a3de-294b5fb568e8 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:32.827215 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ffd9dff3-daf6-406e-a3de-294b5fb568e8 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:32.828002 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ffd9dff3-daf6-406e-a3de-294b5fb568e8 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:32.828996 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ffd9dff3-daf6-406e-a3de-294b5fb568e8 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:32.860672 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ffd9dff3-daf6-406e-a3de-294b5fb568e8 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:32.861250 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ffd9dff3-daf6-406e-a3de-294b5fb568e8 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:32.861761 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.objects.instance [None req-ffd9dff3-daf6-406e-a3de-294b5fb568e8 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lazy-loading 'fault' on Instance uuid df8051e5-6f5b-47e6-9659-02de55bdfee4 {{(pid=116378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 01:30:32.921810 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-ffd9dff3-daf6-406e-a3de-294b5fb568e8 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2dbc6652b34cd3a4fc39dbabd839bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131e8f4d098e4d2ba64328c91f63c18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:32.929273 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-ffd9dff3-daf6-406e-a3de-294b5fb568e8 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] 10.222.0.87 "GET /compute/v2.1/servers/df8051e5-6f5b-47e6-9659-02de55bdfee4" status: 200 len: 1303 microversion: 2.1 time: 0.114287 Oct 29 01:30:32.929824 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 144/290] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:32 2021] GET /compute/v2.1/servers/df8051e5-6f5b-47e6-9659-02de55bdfee4 => generated 1303 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:33.421295 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-9ac521b1-533f-45f5-9e4c-ecbae4363bf3 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:33.422010 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-9ac521b1-533f-45f5-9e4c-ecbae4363bf3 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 8daa36f8-7d64-4d9d-94e6-0519848d4a2c] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:33.429257 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-9ac521b1-533f-45f5-9e4c-ecbae4363bf3 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:33.429928 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-9ac521b1-533f-45f5-9e4c-ecbae4363bf3 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:33.430703 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-9ac521b1-533f-45f5-9e4c-ecbae4363bf3 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:33.431136 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-9ac521b1-533f-45f5-9e4c-ecbae4363bf3 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:33.587784 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-9ac521b1-533f-45f5-9e4c-ecbae4363bf3 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:33.593888 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-9ac521b1-533f-45f5-9e4c-ecbae4363bf3 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c" status: 200 len: 1521 microversion: 2.1 time: 0.176687 Oct 29 01:30:33.596914 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 147/291] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:33 2021] GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:33.612492 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-71a94906-3f64-4be1-b6b8-f2102d443e53 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:33.613423 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-71a94906-3f64-4be1-b6b8-f2102d443e53 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:33.620103 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-71a94906-3f64-4be1-b6b8-f2102d443e53 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:33.620552 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-71a94906-3f64-4be1-b6b8-f2102d443e53 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:33.621388 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-71a94906-3f64-4be1-b6b8-f2102d443e53 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:33.622026 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-71a94906-3f64-4be1-b6b8-f2102d443e53 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:33.640191 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-9ae16e8d-bf1c-4c45-9c33-e80c8c6dda8b tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:33.641790 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-9ae16e8d-bf1c-4c45-9c33-e80c8c6dda8b tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:33.651211 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-9ae16e8d-bf1c-4c45-9c33-e80c8c6dda8b tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:33.651667 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-9ae16e8d-bf1c-4c45-9c33-e80c8c6dda8b tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:33.652484 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-9ae16e8d-bf1c-4c45-9c33-e80c8c6dda8b tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:33.652923 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-9ae16e8d-bf1c-4c45-9c33-e80c8c6dda8b tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:33.737501 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-71a94906-3f64-4be1-b6b8-f2102d443e53 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action" status: 200 len: 25119 microversion: 2.20 time: 0.129765 Oct 29 01:30:33.738996 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 145/292] 10.222.0.87 () {62 vars in 1318 bytes} [Fri Oct 29 01:30:33 2021] POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action => generated 25119 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:30:33.782184 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-9ae16e8d-bf1c-4c45-9c33-e80c8c6dda8b tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action" status: 200 len: 25059 microversion: 2.1 time: 0.151548 Oct 29 01:30:33.782892 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 148/293] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:30:33 2021] POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action => generated 25059 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 01:30:33.953548 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-21300055-424e-43aa-abf7-b373c15f0c70 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:33.954611 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-21300055-424e-43aa-abf7-b373c15f0c70 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] [instance: df8051e5-6f5b-47e6-9659-02de55bdfee4] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:33.961086 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-21300055-424e-43aa-abf7-b373c15f0c70 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:33.967939 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-21300055-424e-43aa-abf7-b373c15f0c70 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:33.967939 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-21300055-424e-43aa-abf7-b373c15f0c70 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:33.967939 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-21300055-424e-43aa-abf7-b373c15f0c70 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:33.979093 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.wsgi [None req-21300055-424e-43aa-abf7-b373c15f0c70 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] HTTP exception thrown: Instance df8051e5-6f5b-47e6-9659-02de55bdfee4 could not be found. Oct 29 01:30:33.979687 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-21300055-424e-43aa-abf7-b373c15f0c70 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Returning 404 to user: Instance df8051e5-6f5b-47e6-9659-02de55bdfee4 could not be found. {{(pid=116378) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:30:33.980912 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-21300055-424e-43aa-abf7-b373c15f0c70 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] 10.222.0.87 "GET /compute/v2.1/servers/df8051e5-6f5b-47e6-9659-02de55bdfee4" status: 404 len: 111 microversion: 2.1 time: 0.032561 Oct 29 01:30:33.981722 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 146/294] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:33 2021] GET /compute/v2.1/servers/df8051e5-6f5b-47e6-9659-02de55bdfee4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:30:34.086195 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-a264f842-5351-4de0-bbcc-ec04171075dc tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-760183678", "imageRef": "3b1d5dc6-2b04-4433-9a93-1db6a740092b", "flavorRef": "452", "networks": [{"uuid": "07cc0a5c-d93c-4a3a-918e-e24f7df3a1ac"}]}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:34.145489 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.network.neutron [None req-a264f842-5351-4de0-bbcc-ec04171075dc tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] validate_networks() for [('07cc0a5c-d93c-4a3a-918e-e24f7df3a1ac', None, None, None, None, None)] {{(pid=116379) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 29 01:30:34.507309 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.virt.hardware [None req-a264f842-5351-4de0-bbcc-ec04171075dc tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Flavor limits 0:0:0 {{(pid=116379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:30:34.507913 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.virt.hardware [None req-a264f842-5351-4de0-bbcc-ec04171075dc tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Image limits 0:0:0 {{(pid=116379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:30:34.508248 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.virt.hardware [None req-a264f842-5351-4de0-bbcc-ec04171075dc tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Flavor pref 0:0:0 {{(pid=116379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:30:34.508650 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.virt.hardware [None req-a264f842-5351-4de0-bbcc-ec04171075dc tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Image pref 0:0:0 {{(pid=116379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:30:34.509084 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.virt.hardware [None req-a264f842-5351-4de0-bbcc-ec04171075dc tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:30:34.518414 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-a264f842-5351-4de0-bbcc-ec04171075dc tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:34.518857 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-a264f842-5351-4de0-bbcc-ec04171075dc tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:34.519706 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-a264f842-5351-4de0-bbcc-ec04171075dc tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:34.520191 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-a264f842-5351-4de0-bbcc-ec04171075dc tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:34.542901 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.quota [None req-a264f842-5351-4de0-bbcc-ec04171075dc tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Getting quotas for project 131e8f4d098e4d2ba64328c91f63c18c. Resources: {'instances', 'cores', 'ram'} {{(pid=116379) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 01:30:34.547815 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.quota [None req-a264f842-5351-4de0-bbcc-ec04171075dc tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Getting quotas for user 5b2dbc6652b34cd3a4fc39dbabd839bc and project 131e8f4d098e4d2ba64328c91f63c18c. Resources: {'instances', 'cores', 'ram'} {{(pid=116379) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 01:30:34.559198 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-a264f842-5351-4de0-bbcc-ec04171075dc tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Going to run 1 instances... {{(pid=116379) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 29 01:30:34.561691 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-a264f842-5351-4de0-bbcc-ec04171075dc tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] [instance: 9f6b1af3-803b-440a-8549-e2297a014690] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3b1d5dc6-2b04-4433-9a93-1db6a740092b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116379) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 29 01:30:34.614673 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-95378042-0dce-471e-bd50-e60bd336b5b3 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:34.615321 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-95378042-0dce-471e-bd50-e60bd336b5b3 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 8daa36f8-7d64-4d9d-94e6-0519848d4a2c] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:34.621952 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-95378042-0dce-471e-bd50-e60bd336b5b3 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:34.622400 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-95378042-0dce-471e-bd50-e60bd336b5b3 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:34.623181 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-95378042-0dce-471e-bd50-e60bd336b5b3 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:34.623675 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-95378042-0dce-471e-bd50-e60bd336b5b3 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:34.725934 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-a264f842-5351-4de0-bbcc-ec04171075dc tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.643734 Oct 29 01:30:34.726571 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 149/295] 10.222.0.87 () {60 vars in 1146 bytes} [Fri Oct 29 01:30:34 2021] POST /compute/v2.1/servers => generated 380 bytes in 645 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:30:34.737172 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-0e4ccab3-951b-4c14-9bcf-67e97e0e432d tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:34.737861 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-0e4ccab3-951b-4c14-9bcf-67e97e0e432d tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] [instance: 9f6b1af3-803b-440a-8549-e2297a014690] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:34.769274 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-95378042-0dce-471e-bd50-e60bd336b5b3 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:34.776971 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-95378042-0dce-471e-bd50-e60bd336b5b3 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c" status: 200 len: 1501 microversion: 2.1 time: 0.167213 Oct 29 01:30:34.778000 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 147/296] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:34 2021] GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c => generated 1501 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:30:34.783913 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-403d29df-8d6d-4379-802c-f67aa4f5e300 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:34.785314 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-403d29df-8d6d-4379-802c-f67aa4f5e300 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:34.795347 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-403d29df-8d6d-4379-802c-f67aa4f5e300 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:34.796652 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-403d29df-8d6d-4379-802c-f67aa4f5e300 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:34.798126 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-403d29df-8d6d-4379-802c-f67aa4f5e300 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:34.798126 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-403d29df-8d6d-4379-802c-f67aa4f5e300 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:34.819444 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-0e4ccab3-951b-4c14-9bcf-67e97e0e432d tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2dbc6652b34cd3a4fc39dbabd839bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131e8f4d098e4d2ba64328c91f63c18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:34.827229 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-0e4ccab3-951b-4c14-9bcf-67e97e0e432d tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] 10.222.0.87 "GET /compute/v2.1/servers/9f6b1af3-803b-440a-8549-e2297a014690" status: 200 len: 1213 microversion: 2.1 time: 0.094356 Oct 29 01:30:34.831422 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 150/297] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:34 2021] GET /compute/v2.1/servers/9f6b1af3-803b-440a-8549-e2297a014690 => generated 1213 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:30:34.836068 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-1f716e58-4e5b-4dc1-a805-9b7258241ae3 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:34.837269 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-1f716e58-4e5b-4dc1-a805-9b7258241ae3 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:34.844750 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-1f716e58-4e5b-4dc1-a805-9b7258241ae3 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:34.844750 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-1f716e58-4e5b-4dc1-a805-9b7258241ae3 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:34.845449 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-1f716e58-4e5b-4dc1-a805-9b7258241ae3 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:34.845878 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-1f716e58-4e5b-4dc1-a805-9b7258241ae3 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:34.928880 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-403d29df-8d6d-4379-802c-f67aa4f5e300 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action" status: 200 len: 26042 microversion: 2.20 time: 0.145284 Oct 29 01:30:34.928880 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 148/298] 10.222.0.87 () {62 vars in 1318 bytes} [Fri Oct 29 01:30:34 2021] POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action => generated 26042 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:30:34.932897 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-0760c917-fabd-43c0-8c80-0bce33c753a5 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:34.933724 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-0760c917-fabd-43c0-8c80-0bce33c753a5 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:34.940573 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-0760c917-fabd-43c0-8c80-0bce33c753a5 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:34.945305 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-0760c917-fabd-43c0-8c80-0bce33c753a5 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:34.946723 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-0760c917-fabd-43c0-8c80-0bce33c753a5 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:34.947358 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-0760c917-fabd-43c0-8c80-0bce33c753a5 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:34.961916 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-1f716e58-4e5b-4dc1-a805-9b7258241ae3 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action" status: 200 len: 25948 microversion: 2.1 time: 0.128462 Oct 29 01:30:34.962742 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 151/299] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:30:34 2021] POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action => generated 25948 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:30:35.130300 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-0760c917-fabd-43c0-8c80-0bce33c753a5 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:35.137742 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-0760c917-fabd-43c0-8c80-0bce33c753a5 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca" status: 200 len: 1514 microversion: 2.1 time: 0.210801 Oct 29 01:30:35.138500 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 149/300] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:34 2021] GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca => generated 1514 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:35.849372 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-519accda-6d18-4795-887e-da06f94062d3 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:35.852738 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-519accda-6d18-4795-887e-da06f94062d3 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] [instance: 9f6b1af3-803b-440a-8549-e2297a014690] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:35.865569 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-519accda-6d18-4795-887e-da06f94062d3 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:35.867034 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-519accda-6d18-4795-887e-da06f94062d3 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:35.867871 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-519accda-6d18-4795-887e-da06f94062d3 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:35.868463 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-519accda-6d18-4795-887e-da06f94062d3 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:35.940118 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-c3f806b4-1a6e-49ae-af76-3355b85d2e57 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:35.942165 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-c3f806b4-1a6e-49ae-af76-3355b85d2e57 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:35.951422 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c3f806b4-1a6e-49ae-af76-3355b85d2e57 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:35.952684 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c3f806b4-1a6e-49ae-af76-3355b85d2e57 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:35.955244 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c3f806b4-1a6e-49ae-af76-3355b85d2e57 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:35.956571 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c3f806b4-1a6e-49ae-af76-3355b85d2e57 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:35.987059 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-519accda-6d18-4795-887e-da06f94062d3 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2dbc6652b34cd3a4fc39dbabd839bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131e8f4d098e4d2ba64328c91f63c18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:35.999709 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-519accda-6d18-4795-887e-da06f94062d3 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] 10.222.0.87 "GET /compute/v2.1/servers/9f6b1af3-803b-440a-8549-e2297a014690" status: 200 len: 1217 microversion: 2.1 time: 0.154646 Oct 29 01:30:36.001187 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 152/301] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:35 2021] GET /compute/v2.1/servers/9f6b1af3-803b-440a-8549-e2297a014690 => generated 1217 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:36.006144 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-71d086b3-7b7e-44a9-a736-d7cadc29e946 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:36.007123 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-71d086b3-7b7e-44a9-a736-d7cadc29e946 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:36.014548 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-71d086b3-7b7e-44a9-a736-d7cadc29e946 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:36.015278 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-71d086b3-7b7e-44a9-a736-d7cadc29e946 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:36.016985 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-71d086b3-7b7e-44a9-a736-d7cadc29e946 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:36.017911 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-71d086b3-7b7e-44a9-a736-d7cadc29e946 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:36.067266 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-c3f806b4-1a6e-49ae-af76-3355b85d2e57 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action" status: 200 len: 26741 microversion: 2.20 time: 0.134406 Oct 29 01:30:36.072262 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 150/302] 10.222.0.87 () {62 vars in 1318 bytes} [Fri Oct 29 01:30:35 2021] POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action => generated 26741 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 29 01:30:36.157644 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-71d086b3-7b7e-44a9-a736-d7cadc29e946 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action" status: 200 len: 26657 microversion: 2.1 time: 0.153845 Oct 29 01:30:36.159496 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 153/303] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:30:36 2021] POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action => generated 26657 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:30:37.175271 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-75b3e995-b88f-4812-8368-9915a8fda748 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:37.175271 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-75b3e995-b88f-4812-8368-9915a8fda748 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] [instance: 9f6b1af3-803b-440a-8549-e2297a014690] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:37.175271 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-75b3e995-b88f-4812-8368-9915a8fda748 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:37.175271 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-75b3e995-b88f-4812-8368-9915a8fda748 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:37.179014 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-75b3e995-b88f-4812-8368-9915a8fda748 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:37.179014 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-75b3e995-b88f-4812-8368-9915a8fda748 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:37.180588 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-75f0e43a-6f89-444d-ade0-67ff6e35bbae tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:37.180588 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-75f0e43a-6f89-444d-ade0-67ff6e35bbae tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:37.180588 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-75f0e43a-6f89-444d-ade0-67ff6e35bbae tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:37.180588 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-75f0e43a-6f89-444d-ade0-67ff6e35bbae tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:37.182226 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-75f0e43a-6f89-444d-ade0-67ff6e35bbae tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:37.182226 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-75f0e43a-6f89-444d-ade0-67ff6e35bbae tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:37.182226 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.objects.instance [None req-75f0e43a-6f89-444d-ade0-67ff6e35bbae tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lazy-loading 'flavor' on Instance uuid 09875e40-e63d-4175-9361-fd9439c0c7ca {{(pid=116379) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 01:30:37.182924 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-75b3e995-b88f-4812-8368-9915a8fda748 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2dbc6652b34cd3a4fc39dbabd839bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131e8f4d098e4d2ba64328c91f63c18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:37.182924 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-75b3e995-b88f-4812-8368-9915a8fda748 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] 10.222.0.87 "GET /compute/v2.1/servers/9f6b1af3-803b-440a-8549-e2297a014690" status: 200 len: 1265 microversion: 2.1 time: 0.094098 Oct 29 01:30:37.182924 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 151/304] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:37 2021] GET /compute/v2.1/servers/9f6b1af3-803b-440a-8549-e2297a014690 => generated 1265 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:37.182924 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-875d1233-8268-47b9-afdd-06aeab5676fa tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:37.183653 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-875d1233-8268-47b9-afdd-06aeab5676fa tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:37.183653 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-875d1233-8268-47b9-afdd-06aeab5676fa tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:37.183653 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-875d1233-8268-47b9-afdd-06aeab5676fa tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:37.183653 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-875d1233-8268-47b9-afdd-06aeab5676fa tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:37.184348 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-875d1233-8268-47b9-afdd-06aeab5676fa tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:37.228563 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-875d1233-8268-47b9-afdd-06aeab5676fa tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action" status: 200 len: 27166 microversion: 2.20 time: 0.118523 Oct 29 01:30:37.229279 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 152/305] 10.222.0.87 () {62 vars in 1318 bytes} [Fri Oct 29 01:30:37 2021] POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action => generated 27166 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:30:37.234343 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-892995d0-5a3e-4fc3-bc08-806d288f21b0 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:37.235885 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-892995d0-5a3e-4fc3-bc08-806d288f21b0 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:37.242757 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-892995d0-5a3e-4fc3-bc08-806d288f21b0 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:37.244345 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-892995d0-5a3e-4fc3-bc08-806d288f21b0 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:37.244345 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-892995d0-5a3e-4fc3-bc08-806d288f21b0 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:37.244560 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-892995d0-5a3e-4fc3-bc08-806d288f21b0 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:37.503140 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-892995d0-5a3e-4fc3-bc08-806d288f21b0 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action" status: 200 len: 27175 microversion: 2.1 time: 0.272244 Oct 29 01:30:37.503953 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 153/306] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:30:37 2021] POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action => generated 27175 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:30:37.506273 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-75f0e43a-6f89-444d-ade0-67ff6e35bbae tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "POST /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca/action" status: 200 len: 32 microversion: 2.1 time: 0.463422 Oct 29 01:30:37.508313 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 154/307] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:30:37 2021] POST /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca/action => generated 32 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 29 01:30:37.516890 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-53e11693-df90-4d5f-961a-aa7d4728a098 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:37.519567 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-53e11693-df90-4d5f-961a-aa7d4728a098 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:37.524150 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-53e11693-df90-4d5f-961a-aa7d4728a098 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:37.524823 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-53e11693-df90-4d5f-961a-aa7d4728a098 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:37.525748 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-53e11693-df90-4d5f-961a-aa7d4728a098 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:37.526371 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-53e11693-df90-4d5f-961a-aa7d4728a098 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:37.772368 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-53e11693-df90-4d5f-961a-aa7d4728a098 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:37.780809 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-53e11693-df90-4d5f-961a-aa7d4728a098 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca" status: 200 len: 1520 microversion: 2.1 time: 0.268237 Oct 29 01:30:37.782161 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 154/308] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:37 2021] GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca => generated 1520 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:38.127088 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-d5b5b0c5-92ef-4984-b039-5a5925239b11 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:38.127893 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-d5b5b0c5-92ef-4984-b039-5a5925239b11 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] [instance: 9f6b1af3-803b-440a-8549-e2297a014690] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:38.138625 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d5b5b0c5-92ef-4984-b039-5a5925239b11 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:38.139071 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d5b5b0c5-92ef-4984-b039-5a5925239b11 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:38.139902 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d5b5b0c5-92ef-4984-b039-5a5925239b11 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:38.140330 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d5b5b0c5-92ef-4984-b039-5a5925239b11 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:38.249293 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-1e87f224-b097-4761-a28b-587f2cc9f819 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:38.249293 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-1e87f224-b097-4761-a28b-587f2cc9f819 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:38.250577 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-1e87f224-b097-4761-a28b-587f2cc9f819 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:38.250753 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-1e87f224-b097-4761-a28b-587f2cc9f819 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:38.251886 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-1e87f224-b097-4761-a28b-587f2cc9f819 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:38.252853 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-1e87f224-b097-4761-a28b-587f2cc9f819 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:38.283668 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-d5b5b0c5-92ef-4984-b039-5a5925239b11 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2dbc6652b34cd3a4fc39dbabd839bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131e8f4d098e4d2ba64328c91f63c18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:38.294039 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-d5b5b0c5-92ef-4984-b039-5a5925239b11 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] 10.222.0.87 "GET /compute/v2.1/servers/9f6b1af3-803b-440a-8549-e2297a014690" status: 200 len: 1271 microversion: 2.1 time: 0.172294 Oct 29 01:30:38.295338 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 155/309] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:38 2021] GET /compute/v2.1/servers/9f6b1af3-803b-440a-8549-e2297a014690 => generated 1271 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:38.383903 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-1e87f224-b097-4761-a28b-587f2cc9f819 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action" status: 200 len: 27502 microversion: 2.20 time: 0.146535 Oct 29 01:30:38.387792 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 155/310] 10.222.0.87 () {62 vars in 1318 bytes} [Fri Oct 29 01:30:38 2021] POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action => generated 27502 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 29 01:30:38.514916 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-8a757a75-e6f2-41d9-b568-9e92c99763ac tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:38.516629 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-8a757a75-e6f2-41d9-b568-9e92c99763ac tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:38.522804 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-8a757a75-e6f2-41d9-b568-9e92c99763ac tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:38.523359 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-8a757a75-e6f2-41d9-b568-9e92c99763ac tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:38.524973 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-8a757a75-e6f2-41d9-b568-9e92c99763ac tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:38.525481 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-8a757a75-e6f2-41d9-b568-9e92c99763ac tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:38.678119 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-8a757a75-e6f2-41d9-b568-9e92c99763ac tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action" status: 200 len: 27624 microversion: 2.1 time: 0.166820 Oct 29 01:30:38.681273 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 156/311] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:30:38 2021] POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action => generated 27624 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:30:38.799000 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-e005a0f0-97f3-4c20-aa1a-e3530d711096 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:38.799688 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-e005a0f0-97f3-4c20-aa1a-e3530d711096 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:38.812663 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-e005a0f0-97f3-4c20-aa1a-e3530d711096 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:38.813112 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-e005a0f0-97f3-4c20-aa1a-e3530d711096 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:38.816261 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-e005a0f0-97f3-4c20-aa1a-e3530d711096 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:38.816630 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-e005a0f0-97f3-4c20-aa1a-e3530d711096 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:39.188814 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-e005a0f0-97f3-4c20-aa1a-e3530d711096 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:39.197062 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-e005a0f0-97f3-4c20-aa1a-e3530d711096 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca" status: 200 len: 1520 microversion: 2.1 time: 0.402293 Oct 29 01:30:39.199376 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 156/312] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:38 2021] GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca => generated 1520 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:39.312115 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-8a1c3014-fdfe-433b-9cfd-7ff61172eab1 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:39.314579 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-8a1c3014-fdfe-433b-9cfd-7ff61172eab1 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] [instance: 9f6b1af3-803b-440a-8549-e2297a014690] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:39.330993 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-8a1c3014-fdfe-433b-9cfd-7ff61172eab1 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:39.331435 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-8a1c3014-fdfe-433b-9cfd-7ff61172eab1 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:39.332251 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-8a1c3014-fdfe-433b-9cfd-7ff61172eab1 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:39.332677 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-8a1c3014-fdfe-433b-9cfd-7ff61172eab1 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:39.399785 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-f309ccb6-ad8e-460d-9c98-0b6fefb19ab3 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:39.400707 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-f309ccb6-ad8e-460d-9c98-0b6fefb19ab3 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:39.407978 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-f309ccb6-ad8e-460d-9c98-0b6fefb19ab3 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:39.409529 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-f309ccb6-ad8e-460d-9c98-0b6fefb19ab3 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:39.409529 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-f309ccb6-ad8e-460d-9c98-0b6fefb19ab3 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:39.409745 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-f309ccb6-ad8e-460d-9c98-0b6fefb19ab3 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:39.527376 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-f309ccb6-ad8e-460d-9c98-0b6fefb19ab3 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action" status: 200 len: 27740 microversion: 2.20 time: 0.129136 Oct 29 01:30:39.527376 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 157/313] 10.222.0.87 () {62 vars in 1318 bytes} [Fri Oct 29 01:30:39 2021] POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action => generated 27740 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 29 01:30:39.616686 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-8a1c3014-fdfe-433b-9cfd-7ff61172eab1 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2dbc6652b34cd3a4fc39dbabd839bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131e8f4d098e4d2ba64328c91f63c18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:39.627770 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-8a1c3014-fdfe-433b-9cfd-7ff61172eab1 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] 10.222.0.87 "GET /compute/v2.1/servers/9f6b1af3-803b-440a-8549-e2297a014690" status: 200 len: 1313 microversion: 2.1 time: 0.319505 Oct 29 01:30:39.628685 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 157/314] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:39 2021] GET /compute/v2.1/servers/9f6b1af3-803b-440a-8549-e2297a014690 => generated 1313 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:39.693429 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-e4c5447c-d755-42e5-85fb-154f2cb92ff8 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:39.694745 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-e4c5447c-d755-42e5-85fb-154f2cb92ff8 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:39.702202 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-e4c5447c-d755-42e5-85fb-154f2cb92ff8 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:39.702645 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-e4c5447c-d755-42e5-85fb-154f2cb92ff8 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:39.703677 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-e4c5447c-d755-42e5-85fb-154f2cb92ff8 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:39.704140 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-e4c5447c-d755-42e5-85fb-154f2cb92ff8 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:39.839640 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-e4c5447c-d755-42e5-85fb-154f2cb92ff8 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action" status: 200 len: 27868 microversion: 2.1 time: 0.151119 Oct 29 01:30:39.840317 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 158/315] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:30:39 2021] POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action => generated 27868 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:30:40.215863 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-4dc50647-855d-4860-9cf7-e2bd7c006393 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:40.216477 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-4dc50647-855d-4860-9cf7-e2bd7c006393 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:40.223618 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-4dc50647-855d-4860-9cf7-e2bd7c006393 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:40.224178 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-4dc50647-855d-4860-9cf7-e2bd7c006393 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:40.224950 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-4dc50647-855d-4860-9cf7-e2bd7c006393 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:40.225395 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-4dc50647-855d-4860-9cf7-e2bd7c006393 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:40.330575 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [req-c3b128c5-c256-4bb1-b5ad-ce77065ce6f6 req-1283a7a3-78bc-4d2a-bcd4-fd2f040d0dd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f6b1af3-803b-440a-8549-e2297a014690", "tag": "43b88bbd-d6d8-4749-9d83-4e72f57efb8c"}]} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:40.332616 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:30:40.332616 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: warnings.warn(msg) Oct 29 01:30:40.340621 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [req-c3b128c5-c256-4bb1-b5ad-ce77065ce6f6 req-1283a7a3-78bc-4d2a-bcd4-fd2f040d0dd2 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:40.341139 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [req-c3b128c5-c256-4bb1-b5ad-ce77065ce6f6 req-1283a7a3-78bc-4d2a-bcd4-fd2f040d0dd2 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:40.354380 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.compute.server_external_events [req-c3b128c5-c256-4bb1-b5ad-ce77065ce6f6 req-1283a7a3-78bc-4d2a-bcd4-fd2f040d0dd2 service nova] Creating event network-changed:43b88bbd-d6d8-4749-9d83-4e72f57efb8c for instance 9f6b1af3-803b-440a-8549-e2297a014690 on hv-cinder-81398 Oct 29 01:30:40.357711 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [req-c3b128c5-c256-4bb1-b5ad-ce77065ce6f6 req-1283a7a3-78bc-4d2a-bcd4-fd2f040d0dd2 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031427 Oct 29 01:30:40.358389 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 159/316] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Oct 29 01:30:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:30:40.414311 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-4dc50647-855d-4860-9cf7-e2bd7c006393 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:40.422440 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-4dc50647-855d-4860-9cf7-e2bd7c006393 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca" status: 200 len: 1520 microversion: 2.1 time: 0.209709 Oct 29 01:30:40.423024 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 158/317] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:40 2021] GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca => generated 1520 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:40.534267 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-5b6a6012-fa03-4246-827a-47208fafa621 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:40.535253 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-5b6a6012-fa03-4246-827a-47208fafa621 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:40.541474 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-5b6a6012-fa03-4246-827a-47208fafa621 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:40.541913 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-5b6a6012-fa03-4246-827a-47208fafa621 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:40.542682 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-5b6a6012-fa03-4246-827a-47208fafa621 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:40.543305 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-5b6a6012-fa03-4246-827a-47208fafa621 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:40.645096 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-7f4047cd-7772-4891-81ad-bfb3d19ad52f tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:40.645777 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-7f4047cd-7772-4891-81ad-bfb3d19ad52f tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] [instance: 9f6b1af3-803b-440a-8549-e2297a014690] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:40.652171 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-7f4047cd-7772-4891-81ad-bfb3d19ad52f tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:40.652363 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-5b6a6012-fa03-4246-827a-47208fafa621 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action" status: 200 len: 27962 microversion: 2.20 time: 0.122908 Oct 29 01:30:40.655768 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 160/318] 10.222.0.87 () {62 vars in 1318 bytes} [Fri Oct 29 01:30:40 2021] POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action => generated 27962 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:30:40.655920 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-7f4047cd-7772-4891-81ad-bfb3d19ad52f tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:40.655920 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-7f4047cd-7772-4891-81ad-bfb3d19ad52f tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:40.655920 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-7f4047cd-7772-4891-81ad-bfb3d19ad52f tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:40.826686 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-7f4047cd-7772-4891-81ad-bfb3d19ad52f tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2dbc6652b34cd3a4fc39dbabd839bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131e8f4d098e4d2ba64328c91f63c18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:40.839982 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-7f4047cd-7772-4891-81ad-bfb3d19ad52f tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] 10.222.0.87 "GET /compute/v2.1/servers/9f6b1af3-803b-440a-8549-e2297a014690" status: 200 len: 1313 microversion: 2.1 time: 0.198512 Oct 29 01:30:40.840565 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 159/319] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:40 2021] GET /compute/v2.1/servers/9f6b1af3-803b-440a-8549-e2297a014690 => generated 1313 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:40.853013 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-ea4d87ae-8b5d-418d-a5e6-ced605675203 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:40.854034 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-ea4d87ae-8b5d-418d-a5e6-ced605675203 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:40.862036 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ea4d87ae-8b5d-418d-a5e6-ced605675203 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:40.862493 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ea4d87ae-8b5d-418d-a5e6-ced605675203 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:40.863271 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ea4d87ae-8b5d-418d-a5e6-ced605675203 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:40.863700 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ea4d87ae-8b5d-418d-a5e6-ced605675203 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:40.998110 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-ea4d87ae-8b5d-418d-a5e6-ced605675203 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action" status: 200 len: 28049 microversion: 2.1 time: 0.148345 Oct 29 01:30:40.999540 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 161/320] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:30:40 2021] POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action => generated 28049 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:30:41.440857 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-1bb54467-a2a0-4563-adc9-648406117463 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:41.441527 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-1bb54467-a2a0-4563-adc9-648406117463 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:41.448421 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-1bb54467-a2a0-4563-adc9-648406117463 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:41.448874 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-1bb54467-a2a0-4563-adc9-648406117463 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:41.450690 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-1bb54467-a2a0-4563-adc9-648406117463 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:41.450690 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-1bb54467-a2a0-4563-adc9-648406117463 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:41.589880 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-1bb54467-a2a0-4563-adc9-648406117463 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:41.597916 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-1bb54467-a2a0-4563-adc9-648406117463 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca" status: 200 len: 1520 microversion: 2.1 time: 0.161322 Oct 29 01:30:41.598719 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 160/321] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:41 2021] GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:41.664292 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-fdd54fe2-65b2-4b35-b79a-04b8de808e20 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:41.665202 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-fdd54fe2-65b2-4b35-b79a-04b8de808e20 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:41.672041 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-fdd54fe2-65b2-4b35-b79a-04b8de808e20 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:41.672511 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-fdd54fe2-65b2-4b35-b79a-04b8de808e20 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:41.673231 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-fdd54fe2-65b2-4b35-b79a-04b8de808e20 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:41.673658 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-fdd54fe2-65b2-4b35-b79a-04b8de808e20 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:41.788941 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-fdd54fe2-65b2-4b35-b79a-04b8de808e20 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action" status: 200 len: 28216 microversion: 2.20 time: 0.128619 Oct 29 01:30:41.789579 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 162/322] 10.222.0.87 () {62 vars in 1318 bytes} [Fri Oct 29 01:30:41 2021] POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action => generated 28216 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:30:41.857403 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-c2db3925-a3ad-4980-ba2e-1952fc5daa1e tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:41.858006 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-c2db3925-a3ad-4980-ba2e-1952fc5daa1e tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] [instance: 9f6b1af3-803b-440a-8549-e2297a014690] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:41.864845 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-c2db3925-a3ad-4980-ba2e-1952fc5daa1e tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:41.865298 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-c2db3925-a3ad-4980-ba2e-1952fc5daa1e tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:41.866112 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-c2db3925-a3ad-4980-ba2e-1952fc5daa1e tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:41.866539 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-c2db3925-a3ad-4980-ba2e-1952fc5daa1e tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:41.992103 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-c2db3925-a3ad-4980-ba2e-1952fc5daa1e tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2dbc6652b34cd3a4fc39dbabd839bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131e8f4d098e4d2ba64328c91f63c18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:42.000373 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-c2db3925-a3ad-4980-ba2e-1952fc5daa1e tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] 10.222.0.87 "GET /compute/v2.1/servers/9f6b1af3-803b-440a-8549-e2297a014690" status: 200 len: 1313 microversion: 2.1 time: 0.146060 Oct 29 01:30:42.001552 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 161/323] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:41 2021] GET /compute/v2.1/servers/9f6b1af3-803b-440a-8549-e2297a014690 => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:30:42.010728 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-53a1245e-f8f9-4c63-8293-2cc5f90cc8ad tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-984353161", "imageRef": "3b1d5dc6-2b04-4433-9a93-1db6a740092b", "flavorRef": "452", "networks": [{"uuid": "a043b94c-5557-4790-9d4f-a18ae31f901e"}]}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:42.020042 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-9007d65b-4a61-46e2-9881-8d6d9d3c5154 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:42.020042 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-9007d65b-4a61-46e2-9881-8d6d9d3c5154 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:42.020042 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-9007d65b-4a61-46e2-9881-8d6d9d3c5154 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:42.020458 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-9007d65b-4a61-46e2-9881-8d6d9d3c5154 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:42.021273 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-9007d65b-4a61-46e2-9881-8d6d9d3c5154 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:42.021700 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-9007d65b-4a61-46e2-9881-8d6d9d3c5154 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:42.065355 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.network.neutron [None req-53a1245e-f8f9-4c63-8293-2cc5f90cc8ad tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] validate_networks() for [('a043b94c-5557-4790-9d4f-a18ae31f901e', None, None, None, None, None)] {{(pid=116379) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 29 01:30:42.136103 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-9007d65b-4a61-46e2-9881-8d6d9d3c5154 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action" status: 200 len: 28237 microversion: 2.1 time: 0.128709 Oct 29 01:30:42.136856 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 163/324] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:30:42 2021] POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action => generated 28237 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:30:42.461192 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.virt.hardware [None req-53a1245e-f8f9-4c63-8293-2cc5f90cc8ad tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Flavor limits 0:0:0 {{(pid=116379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:30:42.461690 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.virt.hardware [None req-53a1245e-f8f9-4c63-8293-2cc5f90cc8ad tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Image limits 0:0:0 {{(pid=116379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:30:42.462341 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.virt.hardware [None req-53a1245e-f8f9-4c63-8293-2cc5f90cc8ad tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Flavor pref 0:0:0 {{(pid=116379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:30:42.462886 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.virt.hardware [None req-53a1245e-f8f9-4c63-8293-2cc5f90cc8ad tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Image pref 0:0:0 {{(pid=116379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:30:42.463365 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.virt.hardware [None req-53a1245e-f8f9-4c63-8293-2cc5f90cc8ad tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:30:42.472394 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-53a1245e-f8f9-4c63-8293-2cc5f90cc8ad tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:42.472990 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-53a1245e-f8f9-4c63-8293-2cc5f90cc8ad tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:42.473866 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-53a1245e-f8f9-4c63-8293-2cc5f90cc8ad tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:42.474384 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-53a1245e-f8f9-4c63-8293-2cc5f90cc8ad tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:42.492776 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.quota [None req-53a1245e-f8f9-4c63-8293-2cc5f90cc8ad tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Getting quotas for project 7aa66fedc6704473996d04ffbf8135e0. Resources: {'instances', 'cores', 'ram'} {{(pid=116379) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 01:30:42.496811 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.quota [None req-53a1245e-f8f9-4c63-8293-2cc5f90cc8ad tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Getting quotas for user 34ad077fd0164d3c8b4db14262186901 and project 7aa66fedc6704473996d04ffbf8135e0. Resources: {'instances', 'cores', 'ram'} {{(pid=116379) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 01:30:42.508283 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-53a1245e-f8f9-4c63-8293-2cc5f90cc8ad tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Going to run 1 instances... {{(pid=116379) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 29 01:30:42.510591 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-53a1245e-f8f9-4c63-8293-2cc5f90cc8ad tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] [instance: 93f60f90-a29b-4ae7-b9dc-ec821e4c7e10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3b1d5dc6-2b04-4433-9a93-1db6a740092b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116379) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 29 01:30:42.615039 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-d0826ca9-38a1-4ea5-8877-6cd677047e8b tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:42.615721 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-d0826ca9-38a1-4ea5-8877-6cd677047e8b tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:42.622609 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-d0826ca9-38a1-4ea5-8877-6cd677047e8b tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:42.623058 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-d0826ca9-38a1-4ea5-8877-6cd677047e8b tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:42.623878 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-d0826ca9-38a1-4ea5-8877-6cd677047e8b tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:42.624304 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-d0826ca9-38a1-4ea5-8877-6cd677047e8b tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:42.704537 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-53a1245e-f8f9-4c63-8293-2cc5f90cc8ad tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.697330 Oct 29 01:30:42.705498 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 162/325] 10.222.0.87 () {60 vars in 1146 bytes} [Fri Oct 29 01:30:42 2021] POST /compute/v2.1/servers => generated 380 bytes in 699 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:30:42.715832 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-5b24b00d-ad67-4b02-848b-21ff7d78acd8 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:42.716470 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-5b24b00d-ad67-4b02-848b-21ff7d78acd8 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] [instance: 93f60f90-a29b-4ae7-b9dc-ec821e4c7e10] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:42.791161 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-5b24b00d-ad67-4b02-848b-21ff7d78acd8 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ad077fd0164d3c8b4db14262186901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa66fedc6704473996d04ffbf8135e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:42.800056 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-d0826ca9-38a1-4ea5-8877-6cd677047e8b tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:42.802294 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-5b24b00d-ad67-4b02-848b-21ff7d78acd8 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] 10.222.0.87 "GET /compute/v2.1/servers/93f60f90-a29b-4ae7-b9dc-ec821e4c7e10" status: 200 len: 1218 microversion: 2.1 time: 0.090420 Oct 29 01:30:42.802873 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 163/326] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:42 2021] GET /compute/v2.1/servers/93f60f90-a29b-4ae7-b9dc-ec821e4c7e10 => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:42.807574 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-d0826ca9-38a1-4ea5-8877-6cd677047e8b tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca" status: 200 len: 1520 microversion: 2.1 time: 0.196509 Oct 29 01:30:42.808048 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-e3c1953d-f42e-4c62-8a6e-00386d357f1a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:42.808934 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 164/327] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:42 2021] GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca => generated 1520 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:30:42.809319 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-e3c1953d-f42e-4c62-8a6e-00386d357f1a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:42.820897 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-e3c1953d-f42e-4c62-8a6e-00386d357f1a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:42.821348 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-e3c1953d-f42e-4c62-8a6e-00386d357f1a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:42.823360 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-e3c1953d-f42e-4c62-8a6e-00386d357f1a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:42.823835 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-e3c1953d-f42e-4c62-8a6e-00386d357f1a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:42.901522 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-e3c1953d-f42e-4c62-8a6e-00386d357f1a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action" status: 200 len: 28216 microversion: 2.20 time: 0.097191 Oct 29 01:30:42.905718 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 164/328] 10.222.0.87 () {62 vars in 1318 bytes} [Fri Oct 29 01:30:42 2021] POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action => generated 28216 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:30:43.017478 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-cc0d1d71-ad14-4aa9-b494-ec8dd7a9f860 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:43.017997 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-cc0d1d71-ad14-4aa9-b494-ec8dd7a9f860 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] [instance: 9f6b1af3-803b-440a-8549-e2297a014690] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:43.024567 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-cc0d1d71-ad14-4aa9-b494-ec8dd7a9f860 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:43.025030 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-cc0d1d71-ad14-4aa9-b494-ec8dd7a9f860 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:43.025809 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-cc0d1d71-ad14-4aa9-b494-ec8dd7a9f860 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:43.026235 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-cc0d1d71-ad14-4aa9-b494-ec8dd7a9f860 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:43.150247 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-950c59e5-03d4-4063-a7c7-14f0a94a08e1 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:43.151628 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-950c59e5-03d4-4063-a7c7-14f0a94a08e1 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:43.160615 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-950c59e5-03d4-4063-a7c7-14f0a94a08e1 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:43.161395 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-950c59e5-03d4-4063-a7c7-14f0a94a08e1 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:43.162388 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-950c59e5-03d4-4063-a7c7-14f0a94a08e1 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:43.163025 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-950c59e5-03d4-4063-a7c7-14f0a94a08e1 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:43.170611 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-cc0d1d71-ad14-4aa9-b494-ec8dd7a9f860 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2dbc6652b34cd3a4fc39dbabd839bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131e8f4d098e4d2ba64328c91f63c18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:43.182422 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-cc0d1d71-ad14-4aa9-b494-ec8dd7a9f860 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] 10.222.0.87 "GET /compute/v2.1/servers/9f6b1af3-803b-440a-8549-e2297a014690" status: 200 len: 1313 microversion: 2.1 time: 0.168735 Oct 29 01:30:43.185145 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 165/329] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:43 2021] GET /compute/v2.1/servers/9f6b1af3-803b-440a-8549-e2297a014690 => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:43.263886 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-950c59e5-03d4-4063-a7c7-14f0a94a08e1 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action" status: 200 len: 28237 microversion: 2.1 time: 0.118225 Oct 29 01:30:43.264646 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 165/330] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:30:43 2021] POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action => generated 28237 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 01:30:43.818976 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-7b8df4ff-7452-4a30-ab78-9a0b11c71ab0 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:43.819613 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-7b8df4ff-7452-4a30-ab78-9a0b11c71ab0 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] [instance: 93f60f90-a29b-4ae7-b9dc-ec821e4c7e10] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:43.825628 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-ef8d2819-d257-4047-9d42-7c8a59e532a1 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:43.826312 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-ef8d2819-d257-4047-9d42-7c8a59e532a1 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:43.840654 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-ef8d2819-d257-4047-9d42-7c8a59e532a1 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:43.841211 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-ef8d2819-d257-4047-9d42-7c8a59e532a1 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:43.841923 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-ef8d2819-d257-4047-9d42-7c8a59e532a1 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:43.842347 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-ef8d2819-d257-4047-9d42-7c8a59e532a1 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:43.884083 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-7b8df4ff-7452-4a30-ab78-9a0b11c71ab0 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ad077fd0164d3c8b4db14262186901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa66fedc6704473996d04ffbf8135e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:43.893363 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-7b8df4ff-7452-4a30-ab78-9a0b11c71ab0 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] 10.222.0.87 "GET /compute/v2.1/servers/93f60f90-a29b-4ae7-b9dc-ec821e4c7e10" status: 200 len: 1218 microversion: 2.1 time: 0.077990 Oct 29 01:30:43.893957 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 166/331] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:43 2021] GET /compute/v2.1/servers/93f60f90-a29b-4ae7-b9dc-ec821e4c7e10 => generated 1218 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:43.913760 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-4ab2430e-0b28-4301-8beb-c668d5e97a5f tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:43.914757 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-4ab2430e-0b28-4301-8beb-c668d5e97a5f tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:43.926778 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4ab2430e-0b28-4301-8beb-c668d5e97a5f tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:43.927438 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4ab2430e-0b28-4301-8beb-c668d5e97a5f tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:43.928662 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4ab2430e-0b28-4301-8beb-c668d5e97a5f tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:43.929250 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4ab2430e-0b28-4301-8beb-c668d5e97a5f tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:43.985701 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-ef8d2819-d257-4047-9d42-7c8a59e532a1 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:43.993516 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-ef8d2819-d257-4047-9d42-7c8a59e532a1 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca" status: 200 len: 1520 microversion: 2.1 time: 0.172202 Oct 29 01:30:44.003206 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 166/332] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:43 2021] GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:30:44.023854 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-4ab2430e-0b28-4301-8beb-c668d5e97a5f tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action" status: 200 len: 28216 microversion: 2.20 time: 0.113551 Oct 29 01:30:44.028395 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 167/333] 10.222.0.87 () {62 vars in 1318 bytes} [Fri Oct 29 01:30:43 2021] POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action => generated 28216 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 29 01:30:44.202692 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-987ff315-db66-48f7-be95-d0eecaeb8fb6 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:44.204078 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-987ff315-db66-48f7-be95-d0eecaeb8fb6 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] [instance: 9f6b1af3-803b-440a-8549-e2297a014690] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:44.211168 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-987ff315-db66-48f7-be95-d0eecaeb8fb6 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:44.211650 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-987ff315-db66-48f7-be95-d0eecaeb8fb6 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:44.220771 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-987ff315-db66-48f7-be95-d0eecaeb8fb6 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:44.220771 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-987ff315-db66-48f7-be95-d0eecaeb8fb6 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:44.279001 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-4804a5c1-b8f9-4fe1-a53d-961a83f1fbf5 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:44.281928 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-4804a5c1-b8f9-4fe1-a53d-961a83f1fbf5 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:44.292507 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4804a5c1-b8f9-4fe1-a53d-961a83f1fbf5 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:44.293424 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4804a5c1-b8f9-4fe1-a53d-961a83f1fbf5 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:44.294596 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4804a5c1-b8f9-4fe1-a53d-961a83f1fbf5 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:44.295252 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4804a5c1-b8f9-4fe1-a53d-961a83f1fbf5 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:44.376435 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-987ff315-db66-48f7-be95-d0eecaeb8fb6 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2dbc6652b34cd3a4fc39dbabd839bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131e8f4d098e4d2ba64328c91f63c18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:44.384550 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-987ff315-db66-48f7-be95-d0eecaeb8fb6 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] 10.222.0.87 "GET /compute/v2.1/servers/9f6b1af3-803b-440a-8549-e2297a014690" status: 200 len: 1313 microversion: 2.1 time: 0.185843 Oct 29 01:30:44.385209 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 167/334] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:44 2021] GET /compute/v2.1/servers/9f6b1af3-803b-440a-8549-e2297a014690 => generated 1313 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:44.400401 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-4804a5c1-b8f9-4fe1-a53d-961a83f1fbf5 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action" status: 200 len: 28237 microversion: 2.1 time: 0.125973 Oct 29 01:30:44.401081 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 168/335] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:30:44 2021] POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action => generated 28237 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 01:30:44.910089 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-bb1b2e56-de97-43b9-bbeb-95e0121b9525 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:44.910803 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-bb1b2e56-de97-43b9-bbeb-95e0121b9525 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] [instance: 93f60f90-a29b-4ae7-b9dc-ec821e4c7e10] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:44.921362 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-bb1b2e56-de97-43b9-bbeb-95e0121b9525 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:44.922444 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-bb1b2e56-de97-43b9-bbeb-95e0121b9525 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:44.923256 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-bb1b2e56-de97-43b9-bbeb-95e0121b9525 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:44.923661 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-bb1b2e56-de97-43b9-bbeb-95e0121b9525 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:44.989760 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-bb1b2e56-de97-43b9-bbeb-95e0121b9525 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ad077fd0164d3c8b4db14262186901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa66fedc6704473996d04ffbf8135e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:44.997283 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-bb1b2e56-de97-43b9-bbeb-95e0121b9525 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] 10.222.0.87 "GET /compute/v2.1/servers/93f60f90-a29b-4ae7-b9dc-ec821e4c7e10" status: 200 len: 1270 microversion: 2.1 time: 0.091494 Oct 29 01:30:44.998226 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 168/336] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:44 2021] GET /compute/v2.1/servers/93f60f90-a29b-4ae7-b9dc-ec821e4c7e10 => generated 1270 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:45.011687 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-45097796-5e80-485a-935e-ae2c382fe37b tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:45.012465 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-45097796-5e80-485a-935e-ae2c382fe37b tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:45.019751 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-45097796-5e80-485a-935e-ae2c382fe37b tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:45.020209 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-45097796-5e80-485a-935e-ae2c382fe37b tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:45.021125 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-45097796-5e80-485a-935e-ae2c382fe37b tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:45.022509 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-45097796-5e80-485a-935e-ae2c382fe37b tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:45.038564 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-7ad7e69e-e270-4a7c-90e0-d2a20c0a120e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:45.039479 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-7ad7e69e-e270-4a7c-90e0-d2a20c0a120e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:45.045336 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-7ad7e69e-e270-4a7c-90e0-d2a20c0a120e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:45.045783 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-7ad7e69e-e270-4a7c-90e0-d2a20c0a120e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:45.046587 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-7ad7e69e-e270-4a7c-90e0-d2a20c0a120e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:45.047601 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-7ad7e69e-e270-4a7c-90e0-d2a20c0a120e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:45.156766 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-45097796-5e80-485a-935e-ae2c382fe37b tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:45.158521 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-7ad7e69e-e270-4a7c-90e0-d2a20c0a120e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action" status: 200 len: 28337 microversion: 2.20 time: 0.123669 Oct 29 01:30:45.159765 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 169/337] 10.222.0.87 () {62 vars in 1318 bytes} [Fri Oct 29 01:30:45 2021] POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action => generated 28337 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 29 01:30:45.165287 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-45097796-5e80-485a-935e-ae2c382fe37b tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca" status: 200 len: 1520 microversion: 2.1 time: 0.157891 Oct 29 01:30:45.165852 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 169/338] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:45 2021] GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:45.403295 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-c353aa30-c9cd-46ef-b64a-2cbb1dda30ad tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:45.404011 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-c353aa30-c9cd-46ef-b64a-2cbb1dda30ad tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] [instance: 9f6b1af3-803b-440a-8549-e2297a014690] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:45.413583 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-c353aa30-c9cd-46ef-b64a-2cbb1dda30ad tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:45.413830 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-c353aa30-c9cd-46ef-b64a-2cbb1dda30ad tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:45.414626 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-c353aa30-c9cd-46ef-b64a-2cbb1dda30ad tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:45.415055 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-c353aa30-c9cd-46ef-b64a-2cbb1dda30ad tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:45.418763 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-4b6d4b42-e183-4c44-8853-385318b548ea tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:45.419966 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-4b6d4b42-e183-4c44-8853-385318b548ea tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:45.431330 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4b6d4b42-e183-4c44-8853-385318b548ea tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:45.431330 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4b6d4b42-e183-4c44-8853-385318b548ea tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:45.431330 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4b6d4b42-e183-4c44-8853-385318b548ea tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:45.431330 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4b6d4b42-e183-4c44-8853-385318b548ea tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:45.582373 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-4b6d4b42-e183-4c44-8853-385318b548ea tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action" status: 200 len: 28527 microversion: 2.1 time: 0.170127 Oct 29 01:30:45.582373 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 170/339] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:30:45 2021] POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action => generated 28527 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 01:30:45.702603 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-c353aa30-c9cd-46ef-b64a-2cbb1dda30ad tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2dbc6652b34cd3a4fc39dbabd839bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131e8f4d098e4d2ba64328c91f63c18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:45.724018 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-c353aa30-c9cd-46ef-b64a-2cbb1dda30ad tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] 10.222.0.87 "GET /compute/v2.1/servers/9f6b1af3-803b-440a-8549-e2297a014690" status: 200 len: 1313 microversion: 2.1 time: 0.324440 Oct 29 01:30:45.726172 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 170/340] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:45 2021] GET /compute/v2.1/servers/9f6b1af3-803b-440a-8549-e2297a014690 => generated 1313 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:45.742444 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [req-03ba880a-d55b-470b-86ff-786d6c1ca28a req-c5c1113b-fecf-4177-920a-a765ff89cd48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f6b1af3-803b-440a-8549-e2297a014690", "name": "network-vif-plugged", "status": "completed", "tag": "43b88bbd-d6d8-4749-9d83-4e72f57efb8c"}]} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:45.744694 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:30:45.744694 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: warnings.warn(msg) Oct 29 01:30:45.753495 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [req-03ba880a-d55b-470b-86ff-786d6c1ca28a req-c5c1113b-fecf-4177-920a-a765ff89cd48 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:45.754267 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [req-03ba880a-d55b-470b-86ff-786d6c1ca28a req-c5c1113b-fecf-4177-920a-a765ff89cd48 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:45.769415 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.compute.server_external_events [req-03ba880a-d55b-470b-86ff-786d6c1ca28a req-c5c1113b-fecf-4177-920a-a765ff89cd48 service nova] Creating event network-vif-plugged:43b88bbd-d6d8-4749-9d83-4e72f57efb8c for instance 9f6b1af3-803b-440a-8549-e2297a014690 on hv-cinder-81398 Oct 29 01:30:45.774156 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [req-03ba880a-d55b-470b-86ff-786d6c1ca28a req-c5c1113b-fecf-4177-920a-a765ff89cd48 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035672 Oct 29 01:30:45.774738 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 171/341] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Oct 29 01:30:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:30:46.017866 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-ffb76b9f-b23c-471b-858a-68d15d306db5 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:46.018990 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-ffb76b9f-b23c-471b-858a-68d15d306db5 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] [instance: 93f60f90-a29b-4ae7-b9dc-ec821e4c7e10] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:46.026623 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-ffb76b9f-b23c-471b-858a-68d15d306db5 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:46.027284 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-ffb76b9f-b23c-471b-858a-68d15d306db5 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:46.028295 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-ffb76b9f-b23c-471b-858a-68d15d306db5 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:46.028877 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-ffb76b9f-b23c-471b-858a-68d15d306db5 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:46.108172 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-ffb76b9f-b23c-471b-858a-68d15d306db5 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ad077fd0164d3c8b4db14262186901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa66fedc6704473996d04ffbf8135e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:46.116984 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-ffb76b9f-b23c-471b-858a-68d15d306db5 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] 10.222.0.87 "GET /compute/v2.1/servers/93f60f90-a29b-4ae7-b9dc-ec821e4c7e10" status: 200 len: 1276 microversion: 2.1 time: 0.105922 Oct 29 01:30:46.117790 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 171/342] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:46 2021] GET /compute/v2.1/servers/93f60f90-a29b-4ae7-b9dc-ec821e4c7e10 => generated 1276 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:46.171843 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-7987188b-7913-4c67-8061-2b71af3634fa tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:46.173671 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-7987188b-7913-4c67-8061-2b71af3634fa tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:46.180686 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-7987188b-7913-4c67-8061-2b71af3634fa tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:46.181241 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-7987188b-7913-4c67-8061-2b71af3634fa tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:46.182482 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-7987188b-7913-4c67-8061-2b71af3634fa tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:46.183074 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-7987188b-7913-4c67-8061-2b71af3634fa tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:46.188288 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-3c9eda7b-f585-47e3-8f25-ebdc8ab57b18 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:46.189182 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-3c9eda7b-f585-47e3-8f25-ebdc8ab57b18 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:46.198528 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-3c9eda7b-f585-47e3-8f25-ebdc8ab57b18 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:46.198981 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-3c9eda7b-f585-47e3-8f25-ebdc8ab57b18 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:46.200107 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-3c9eda7b-f585-47e3-8f25-ebdc8ab57b18 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:46.200631 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-3c9eda7b-f585-47e3-8f25-ebdc8ab57b18 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:46.341942 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-7987188b-7913-4c67-8061-2b71af3634fa tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action" status: 200 len: 28503 microversion: 2.20 time: 0.174593 Oct 29 01:30:46.342606 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 172/343] 10.222.0.87 () {62 vars in 1318 bytes} [Fri Oct 29 01:30:46 2021] POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action => generated 28503 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 29 01:30:46.433728 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-3c9eda7b-f585-47e3-8f25-ebdc8ab57b18 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:46.443039 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-3c9eda7b-f585-47e3-8f25-ebdc8ab57b18 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca" status: 200 len: 1520 microversion: 2.1 time: 0.260154 Oct 29 01:30:46.452593 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 172/344] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:46 2021] GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca => generated 1520 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:46.595575 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-11880bf3-6082-41b9-9133-1ea1145f5ba6 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:46.597537 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-11880bf3-6082-41b9-9133-1ea1145f5ba6 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:46.606689 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-11880bf3-6082-41b9-9133-1ea1145f5ba6 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:46.607300 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-11880bf3-6082-41b9-9133-1ea1145f5ba6 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:46.610490 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-11880bf3-6082-41b9-9133-1ea1145f5ba6 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:46.613954 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-11880bf3-6082-41b9-9133-1ea1145f5ba6 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:46.752508 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-d7ef7c1f-ac18-492f-bf0a-3318a0fceae5 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:46.753637 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-d7ef7c1f-ac18-492f-bf0a-3318a0fceae5 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] [instance: 9f6b1af3-803b-440a-8549-e2297a014690] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:46.757886 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-11880bf3-6082-41b9-9133-1ea1145f5ba6 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action" status: 200 len: 28527 microversion: 2.1 time: 0.161609 Oct 29 01:30:46.765964 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 173/345] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:30:46 2021] POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action => generated 28527 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:30:46.770751 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d7ef7c1f-ac18-492f-bf0a-3318a0fceae5 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:46.771419 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d7ef7c1f-ac18-492f-bf0a-3318a0fceae5 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:46.772441 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d7ef7c1f-ac18-492f-bf0a-3318a0fceae5 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:46.773033 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d7ef7c1f-ac18-492f-bf0a-3318a0fceae5 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:47.067700 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-d7ef7c1f-ac18-492f-bf0a-3318a0fceae5 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2dbc6652b34cd3a4fc39dbabd839bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131e8f4d098e4d2ba64328c91f63c18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:47.078772 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-d7ef7c1f-ac18-492f-bf0a-3318a0fceae5 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] 10.222.0.87 "GET /compute/v2.1/servers/9f6b1af3-803b-440a-8549-e2297a014690" status: 200 len: 1313 microversion: 2.1 time: 0.331273 Oct 29 01:30:47.079374 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 173/346] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:46 2021] GET /compute/v2.1/servers/9f6b1af3-803b-440a-8549-e2297a014690 => generated 1313 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:47.135210 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-4c919ceb-f296-46d5-8d5b-08bb4214abc4 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:47.137548 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-4c919ceb-f296-46d5-8d5b-08bb4214abc4 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] [instance: 93f60f90-a29b-4ae7-b9dc-ec821e4c7e10] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:47.148762 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4c919ceb-f296-46d5-8d5b-08bb4214abc4 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:47.150313 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4c919ceb-f296-46d5-8d5b-08bb4214abc4 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:47.151374 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4c919ceb-f296-46d5-8d5b-08bb4214abc4 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:47.152055 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4c919ceb-f296-46d5-8d5b-08bb4214abc4 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:47.327353 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-4c919ceb-f296-46d5-8d5b-08bb4214abc4 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ad077fd0164d3c8b4db14262186901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa66fedc6704473996d04ffbf8135e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:47.338308 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-4c919ceb-f296-46d5-8d5b-08bb4214abc4 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] 10.222.0.87 "GET /compute/v2.1/servers/93f60f90-a29b-4ae7-b9dc-ec821e4c7e10" status: 200 len: 1318 microversion: 2.1 time: 0.207134 Oct 29 01:30:47.348027 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 174/347] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:47 2021] GET /compute/v2.1/servers/93f60f90-a29b-4ae7-b9dc-ec821e4c7e10 => generated 1318 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:47.354741 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-2c04b621-840f-4f18-973a-6197ccfa5bbc tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:47.358552 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-2c04b621-840f-4f18-973a-6197ccfa5bbc tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:47.365043 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-2c04b621-840f-4f18-973a-6197ccfa5bbc tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:47.365519 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-2c04b621-840f-4f18-973a-6197ccfa5bbc tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:47.367381 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-2c04b621-840f-4f18-973a-6197ccfa5bbc tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:47.368043 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-2c04b621-840f-4f18-973a-6197ccfa5bbc tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:47.470033 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-702961cd-ea1c-4b6a-8d10-9ac03dcd16da tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:47.470822 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-702961cd-ea1c-4b6a-8d10-9ac03dcd16da tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:47.479163 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-702961cd-ea1c-4b6a-8d10-9ac03dcd16da tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:47.481202 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-702961cd-ea1c-4b6a-8d10-9ac03dcd16da tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:47.482295 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-702961cd-ea1c-4b6a-8d10-9ac03dcd16da tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:47.483109 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-702961cd-ea1c-4b6a-8d10-9ac03dcd16da tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:47.491407 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-2c04b621-840f-4f18-973a-6197ccfa5bbc tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action" status: 200 len: 28574 microversion: 2.20 time: 0.137846 Oct 29 01:30:47.497564 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 174/348] 10.222.0.87 () {62 vars in 1318 bytes} [Fri Oct 29 01:30:47 2021] POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action => generated 28574 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:30:47.716367 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-702961cd-ea1c-4b6a-8d10-9ac03dcd16da tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:47.724055 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-702961cd-ea1c-4b6a-8d10-9ac03dcd16da tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca" status: 200 len: 1520 microversion: 2.1 time: 0.258597 Oct 29 01:30:47.724548 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 175/349] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:47 2021] GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca => generated 1520 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:47.773810 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-9809f5a0-63bf-4efc-9631-45ff38422de5 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:47.775157 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-9809f5a0-63bf-4efc-9631-45ff38422de5 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:47.784571 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-9809f5a0-63bf-4efc-9631-45ff38422de5 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:47.785026 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-9809f5a0-63bf-4efc-9631-45ff38422de5 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:47.785818 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-9809f5a0-63bf-4efc-9631-45ff38422de5 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:47.786245 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-9809f5a0-63bf-4efc-9631-45ff38422de5 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:47.883285 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [req-4921fb0f-2da2-4c92-b854-b18a8f2d70d0 req-3e49ce41-64ee-45a5-bd06-5720a06e66c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93f60f90-a29b-4ae7-b9dc-ec821e4c7e10", "tag": "bae2e6bb-454a-4acd-acb0-022f69f3a6e8"}]} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:47.885321 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:30:47.885321 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: warnings.warn(msg) Oct 29 01:30:47.898357 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [req-4921fb0f-2da2-4c92-b854-b18a8f2d70d0 req-3e49ce41-64ee-45a5-bd06-5720a06e66c7 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:47.898801 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [req-4921fb0f-2da2-4c92-b854-b18a8f2d70d0 req-3e49ce41-64ee-45a5-bd06-5720a06e66c7 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:47.919591 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.compute.server_external_events [req-4921fb0f-2da2-4c92-b854-b18a8f2d70d0 req-3e49ce41-64ee-45a5-bd06-5720a06e66c7 service nova] Creating event network-changed:bae2e6bb-454a-4acd-acb0-022f69f3a6e8 for instance 93f60f90-a29b-4ae7-b9dc-ec821e4c7e10 on hv-cinder-81398 Oct 29 01:30:47.926130 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [req-4921fb0f-2da2-4c92-b854-b18a8f2d70d0 req-3e49ce41-64ee-45a5-bd06-5720a06e66c7 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060584 Oct 29 01:30:47.927278 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 176/350] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Oct 29 01:30:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:30:47.985394 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-9809f5a0-63bf-4efc-9631-45ff38422de5 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action" status: 200 len: 28695 microversion: 2.1 time: 0.215819 Oct 29 01:30:47.986240 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 175/351] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:30:47 2021] POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action => generated 28695 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:30:48.096683 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-d6497947-b0ed-4a1c-b778-bf61b03c92a5 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:48.097429 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-d6497947-b0ed-4a1c-b778-bf61b03c92a5 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] [instance: 9f6b1af3-803b-440a-8549-e2297a014690] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:48.108195 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-d6497947-b0ed-4a1c-b778-bf61b03c92a5 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:48.109202 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-d6497947-b0ed-4a1c-b778-bf61b03c92a5 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:48.110155 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-d6497947-b0ed-4a1c-b778-bf61b03c92a5 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:48.110726 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-d6497947-b0ed-4a1c-b778-bf61b03c92a5 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:48.357142 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-5fe660af-815a-4370-abd8-b9b61952dc33 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:48.357835 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-5fe660af-815a-4370-abd8-b9b61952dc33 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] [instance: 93f60f90-a29b-4ae7-b9dc-ec821e4c7e10] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:48.377652 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-5fe660af-815a-4370-abd8-b9b61952dc33 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:48.377652 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-5fe660af-815a-4370-abd8-b9b61952dc33 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:48.377652 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-5fe660af-815a-4370-abd8-b9b61952dc33 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:48.377652 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-5fe660af-815a-4370-abd8-b9b61952dc33 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:48.378233 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-d6497947-b0ed-4a1c-b778-bf61b03c92a5 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2dbc6652b34cd3a4fc39dbabd839bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131e8f4d098e4d2ba64328c91f63c18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:48.389322 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-d6497947-b0ed-4a1c-b778-bf61b03c92a5 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] 10.222.0.87 "GET /compute/v2.1/servers/9f6b1af3-803b-440a-8549-e2297a014690" status: 200 len: 1313 microversion: 2.1 time: 0.295884 Oct 29 01:30:48.391686 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 177/352] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:48 2021] GET /compute/v2.1/servers/9f6b1af3-803b-440a-8549-e2297a014690 => generated 1313 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:48.520243 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-31b0936b-ec06-4f6c-8374-96338fbdb4c4 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:48.520361 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-31b0936b-ec06-4f6c-8374-96338fbdb4c4 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:48.536713 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-31b0936b-ec06-4f6c-8374-96338fbdb4c4 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:48.536713 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-31b0936b-ec06-4f6c-8374-96338fbdb4c4 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:48.537557 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-31b0936b-ec06-4f6c-8374-96338fbdb4c4 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:48.538203 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-31b0936b-ec06-4f6c-8374-96338fbdb4c4 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:48.617741 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-5fe660af-815a-4370-abd8-b9b61952dc33 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ad077fd0164d3c8b4db14262186901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa66fedc6704473996d04ffbf8135e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:48.631468 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-5fe660af-815a-4370-abd8-b9b61952dc33 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] 10.222.0.87 "GET /compute/v2.1/servers/93f60f90-a29b-4ae7-b9dc-ec821e4c7e10" status: 200 len: 1318 microversion: 2.1 time: 0.278616 Oct 29 01:30:48.632078 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 176/353] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:48 2021] GET /compute/v2.1/servers/93f60f90-a29b-4ae7-b9dc-ec821e4c7e10 => generated 1318 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:30:48.708762 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-31b0936b-ec06-4f6c-8374-96338fbdb4c4 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action" status: 200 len: 28671 microversion: 2.20 time: 0.195121 Oct 29 01:30:48.715032 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 178/354] 10.222.0.87 () {62 vars in 1318 bytes} [Fri Oct 29 01:30:48 2021] POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action => generated 28671 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:30:48.740532 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-341cd2e4-6e68-424d-9aea-849a84ed271d tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:48.741260 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-341cd2e4-6e68-424d-9aea-849a84ed271d tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:48.751481 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-341cd2e4-6e68-424d-9aea-849a84ed271d tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:48.751481 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-341cd2e4-6e68-424d-9aea-849a84ed271d tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:48.751481 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-341cd2e4-6e68-424d-9aea-849a84ed271d tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:48.751481 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-341cd2e4-6e68-424d-9aea-849a84ed271d tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:48.998924 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-ceff949f-8db6-4dc3-8c82-6fa2f35b7e7e tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:49.000894 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-ceff949f-8db6-4dc3-8c82-6fa2f35b7e7e tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:49.008528 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ceff949f-8db6-4dc3-8c82-6fa2f35b7e7e tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:49.008986 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ceff949f-8db6-4dc3-8c82-6fa2f35b7e7e tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:49.009841 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ceff949f-8db6-4dc3-8c82-6fa2f35b7e7e tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:49.010363 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ceff949f-8db6-4dc3-8c82-6fa2f35b7e7e tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:49.135775 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-ceff949f-8db6-4dc3-8c82-6fa2f35b7e7e tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action" status: 200 len: 28695 microversion: 2.1 time: 0.140290 Oct 29 01:30:49.135775 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 179/355] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:30:48 2021] POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action => generated 28695 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 01:30:49.237632 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-341cd2e4-6e68-424d-9aea-849a84ed271d tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:49.247918 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-341cd2e4-6e68-424d-9aea-849a84ed271d tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca" status: 200 len: 1520 microversion: 2.1 time: 0.510792 Oct 29 01:30:49.249101 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 177/356] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:48 2021] GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca => generated 1520 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:49.408711 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-d4057ebe-aa7f-434b-8071-684f92652406 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:49.411260 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-d4057ebe-aa7f-434b-8071-684f92652406 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] [instance: 9f6b1af3-803b-440a-8549-e2297a014690] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:49.418344 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-d4057ebe-aa7f-434b-8071-684f92652406 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:49.420382 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-d4057ebe-aa7f-434b-8071-684f92652406 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:49.420382 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-d4057ebe-aa7f-434b-8071-684f92652406 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:49.420585 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-d4057ebe-aa7f-434b-8071-684f92652406 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:49.558516 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-d4057ebe-aa7f-434b-8071-684f92652406 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2dbc6652b34cd3a4fc39dbabd839bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131e8f4d098e4d2ba64328c91f63c18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:49.566430 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-d4057ebe-aa7f-434b-8071-684f92652406 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] 10.222.0.87 "GET /compute/v2.1/servers/9f6b1af3-803b-440a-8549-e2297a014690" status: 200 len: 1495 microversion: 2.1 time: 0.162505 Oct 29 01:30:49.566995 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 180/357] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:49 2021] GET /compute/v2.1/servers/9f6b1af3-803b-440a-8549-e2297a014690 => generated 1495 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:49.649265 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-5d5cb124-dcb2-4b5c-875e-e9179bf0ebbd tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:49.649866 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-5d5cb124-dcb2-4b5c-875e-e9179bf0ebbd tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] [instance: 93f60f90-a29b-4ae7-b9dc-ec821e4c7e10] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:49.656975 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-5d5cb124-dcb2-4b5c-875e-e9179bf0ebbd tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:49.657407 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-5d5cb124-dcb2-4b5c-875e-e9179bf0ebbd tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:49.658389 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-5d5cb124-dcb2-4b5c-875e-e9179bf0ebbd tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:49.658822 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-5d5cb124-dcb2-4b5c-875e-e9179bf0ebbd tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:49.720825 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-5000c181-737d-4195-a61e-192388760ba0 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:49.721854 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-5000c181-737d-4195-a61e-192388760ba0 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:49.728146 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-5000c181-737d-4195-a61e-192388760ba0 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:49.728583 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-5000c181-737d-4195-a61e-192388760ba0 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:49.729351 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-5000c181-737d-4195-a61e-192388760ba0 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:49.729771 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-5000c181-737d-4195-a61e-192388760ba0 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:49.795338 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-5d5cb124-dcb2-4b5c-875e-e9179bf0ebbd tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ad077fd0164d3c8b4db14262186901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa66fedc6704473996d04ffbf8135e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:49.804663 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-5d5cb124-dcb2-4b5c-875e-e9179bf0ebbd tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] 10.222.0.87 "GET /compute/v2.1/servers/93f60f90-a29b-4ae7-b9dc-ec821e4c7e10" status: 200 len: 1318 microversion: 2.1 time: 0.159534 Oct 29 01:30:49.805432 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 178/358] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:49 2021] GET /compute/v2.1/servers/93f60f90-a29b-4ae7-b9dc-ec821e4c7e10 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:30:49.838208 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-5000c181-737d-4195-a61e-192388760ba0 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action" status: 200 len: 28671 microversion: 2.20 time: 0.121135 Oct 29 01:30:49.839169 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 181/359] 10.222.0.87 () {62 vars in 1318 bytes} [Fri Oct 29 01:30:49 2021] POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action => generated 28671 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 29 01:30:50.148072 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-98130c2f-7535-4910-817a-4a9f3b269c50 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:50.149025 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-98130c2f-7535-4910-817a-4a9f3b269c50 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:50.155168 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-98130c2f-7535-4910-817a-4a9f3b269c50 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:50.156467 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-98130c2f-7535-4910-817a-4a9f3b269c50 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:50.157286 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-98130c2f-7535-4910-817a-4a9f3b269c50 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:50.159214 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-98130c2f-7535-4910-817a-4a9f3b269c50 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:50.255749 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-98130c2f-7535-4910-817a-4a9f3b269c50 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action" status: 200 len: 28695 microversion: 2.1 time: 0.111442 Oct 29 01:30:50.256397 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 179/360] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:30:50 2021] POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action => generated 28695 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:30:50.275988 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-dc3b7258-d413-4bee-b856-eb48df0905a2 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:50.276737 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-dc3b7258-d413-4bee-b856-eb48df0905a2 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:50.287209 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-dc3b7258-d413-4bee-b856-eb48df0905a2 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:50.290918 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-dc3b7258-d413-4bee-b856-eb48df0905a2 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:50.290918 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-dc3b7258-d413-4bee-b856-eb48df0905a2 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:50.290918 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-dc3b7258-d413-4bee-b856-eb48df0905a2 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:50.434053 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-dc3b7258-d413-4bee-b856-eb48df0905a2 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:50.443141 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-dc3b7258-d413-4bee-b856-eb48df0905a2 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca" status: 200 len: 1520 microversion: 2.1 time: 0.171834 Oct 29 01:30:50.444646 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 182/361] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:50 2021] GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:50.824079 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-d5818dcf-6095-439a-bc5f-a901682a89d7 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:50.825040 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-d5818dcf-6095-439a-bc5f-a901682a89d7 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] [instance: 93f60f90-a29b-4ae7-b9dc-ec821e4c7e10] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:50.832966 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d5818dcf-6095-439a-bc5f-a901682a89d7 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:50.833404 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d5818dcf-6095-439a-bc5f-a901682a89d7 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:50.834168 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d5818dcf-6095-439a-bc5f-a901682a89d7 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:50.834591 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d5818dcf-6095-439a-bc5f-a901682a89d7 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:50.851402 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-96d1e2d7-c7fa-43fa-b481-63893b14837b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:50.852516 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-96d1e2d7-c7fa-43fa-b481-63893b14837b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:50.859759 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-96d1e2d7-c7fa-43fa-b481-63893b14837b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:50.865321 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-96d1e2d7-c7fa-43fa-b481-63893b14837b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:50.865321 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-96d1e2d7-c7fa-43fa-b481-63893b14837b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:50.865321 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-96d1e2d7-c7fa-43fa-b481-63893b14837b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:50.989772 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-96d1e2d7-c7fa-43fa-b481-63893b14837b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action" status: 200 len: 28671 microversion: 2.20 time: 0.142058 Oct 29 01:30:50.991948 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 183/362] 10.222.0.87 () {62 vars in 1318 bytes} [Fri Oct 29 01:30:50 2021] POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action => generated 28671 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 29 01:30:50.994368 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-d5818dcf-6095-439a-bc5f-a901682a89d7 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ad077fd0164d3c8b4db14262186901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa66fedc6704473996d04ffbf8135e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:51.004940 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-d5818dcf-6095-439a-bc5f-a901682a89d7 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] 10.222.0.87 "GET /compute/v2.1/servers/93f60f90-a29b-4ae7-b9dc-ec821e4c7e10" status: 200 len: 1318 microversion: 2.1 time: 0.184920 Oct 29 01:30:51.010638 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 180/363] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:50 2021] GET /compute/v2.1/servers/93f60f90-a29b-4ae7-b9dc-ec821e4c7e10 => generated 1318 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:30:51.145340 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-e4134cc7-0307-4fe9-848c-b3dabe2aadaa tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:51.146395 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-e4134cc7-0307-4fe9-848c-b3dabe2aadaa tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] [instance: 9f6b1af3-803b-440a-8549-e2297a014690] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:51.155158 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-e4134cc7-0307-4fe9-848c-b3dabe2aadaa tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:51.163048 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-e4134cc7-0307-4fe9-848c-b3dabe2aadaa tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:51.163048 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-e4134cc7-0307-4fe9-848c-b3dabe2aadaa tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:51.163048 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-e4134cc7-0307-4fe9-848c-b3dabe2aadaa tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:51.184427 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-e4134cc7-0307-4fe9-848c-b3dabe2aadaa tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] [instance: 9f6b1af3-803b-440a-8549-e2297a014690] Going to try to terminate instance {{(pid=116378) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 29 01:30:51.268153 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-035c1862-5132-4b35-8be8-1e86af0252bd tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:51.269072 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-035c1862-5132-4b35-8be8-1e86af0252bd tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:51.275372 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-035c1862-5132-4b35-8be8-1e86af0252bd tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:51.276198 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-035c1862-5132-4b35-8be8-1e86af0252bd tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:51.276666 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-035c1862-5132-4b35-8be8-1e86af0252bd tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:51.277098 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-035c1862-5132-4b35-8be8-1e86af0252bd tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:51.382154 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-035c1862-5132-4b35-8be8-1e86af0252bd tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action" status: 200 len: 28695 microversion: 2.1 time: 0.116196 Oct 29 01:30:51.382154 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 181/364] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:30:51 2021] POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action => generated 28695 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:30:51.463178 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-c646447b-01e0-4e2d-a77a-8d7f9f80c952 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:51.463920 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-c646447b-01e0-4e2d-a77a-8d7f9f80c952 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:51.471549 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-c646447b-01e0-4e2d-a77a-8d7f9f80c952 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:51.472139 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-c646447b-01e0-4e2d-a77a-8d7f9f80c952 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:51.473312 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-c646447b-01e0-4e2d-a77a-8d7f9f80c952 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:51.473755 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-c646447b-01e0-4e2d-a77a-8d7f9f80c952 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:51.545540 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-e4134cc7-0307-4fe9-848c-b3dabe2aadaa tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] 10.222.0.87 "DELETE /compute/v2.1/servers/9f6b1af3-803b-440a-8549-e2297a014690" status: 204 len: 0 microversion: 2.1 time: 0.405341 Oct 29 01:30:51.547360 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 184/365] 10.222.0.87 () {58 vars in 1238 bytes} [Fri Oct 29 01:30:51 2021] DELETE /compute/v2.1/servers/9f6b1af3-803b-440a-8549-e2297a014690 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:30:51.556213 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-ec6c91ff-11ea-4e6a-b086-d5388b219a08 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:51.557179 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-ec6c91ff-11ea-4e6a-b086-d5388b219a08 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] [instance: 9f6b1af3-803b-440a-8549-e2297a014690] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:51.568234 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ec6c91ff-11ea-4e6a-b086-d5388b219a08 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:51.568234 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ec6c91ff-11ea-4e6a-b086-d5388b219a08 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:51.572575 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ec6c91ff-11ea-4e6a-b086-d5388b219a08 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:51.573191 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ec6c91ff-11ea-4e6a-b086-d5388b219a08 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:51.637297 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-c646447b-01e0-4e2d-a77a-8d7f9f80c952 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:51.645584 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-c646447b-01e0-4e2d-a77a-8d7f9f80c952 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca" status: 200 len: 1520 microversion: 2.1 time: 0.186523 Oct 29 01:30:51.646166 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 182/366] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:51 2021] GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca => generated 1520 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:30:51.716950 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-ec6c91ff-11ea-4e6a-b086-d5388b219a08 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2dbc6652b34cd3a4fc39dbabd839bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131e8f4d098e4d2ba64328c91f63c18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:51.725929 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-ec6c91ff-11ea-4e6a-b086-d5388b219a08 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] 10.222.0.87 "GET /compute/v2.1/servers/9f6b1af3-803b-440a-8549-e2297a014690" status: 200 len: 1501 microversion: 2.1 time: 0.173730 Oct 29 01:30:51.726493 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 185/367] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:51 2021] GET /compute/v2.1/servers/9f6b1af3-803b-440a-8549-e2297a014690 => generated 1501 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:30:52.004657 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-4b9f7887-4b58-4772-8b6f-f962a7d30b25 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:52.005498 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-4b9f7887-4b58-4772-8b6f-f962a7d30b25 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:52.011900 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-4b9f7887-4b58-4772-8b6f-f962a7d30b25 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:52.012582 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-4b9f7887-4b58-4772-8b6f-f962a7d30b25 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:52.013549 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-4b9f7887-4b58-4772-8b6f-f962a7d30b25 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:52.013980 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-4b9f7887-4b58-4772-8b6f-f962a7d30b25 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:52.022359 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-7a4ad165-d118-4d9a-afa5-59b2e5e9564c tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:52.023211 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-7a4ad165-d118-4d9a-afa5-59b2e5e9564c tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] [instance: 93f60f90-a29b-4ae7-b9dc-ec821e4c7e10] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:52.034360 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-7a4ad165-d118-4d9a-afa5-59b2e5e9564c tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:52.034822 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-7a4ad165-d118-4d9a-afa5-59b2e5e9564c tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:52.035976 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-7a4ad165-d118-4d9a-afa5-59b2e5e9564c tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:52.036412 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-7a4ad165-d118-4d9a-afa5-59b2e5e9564c tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:52.104812 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-4b9f7887-4b58-4772-8b6f-f962a7d30b25 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action" status: 200 len: 28671 microversion: 2.20 time: 0.105800 Oct 29 01:30:52.105631 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 183/368] 10.222.0.87 () {62 vars in 1318 bytes} [Fri Oct 29 01:30:51 2021] POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action => generated 28671 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:30:52.184090 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-7a4ad165-d118-4d9a-afa5-59b2e5e9564c tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ad077fd0164d3c8b4db14262186901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa66fedc6704473996d04ffbf8135e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:52.192968 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-7a4ad165-d118-4d9a-afa5-59b2e5e9564c tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] 10.222.0.87 "GET /compute/v2.1/servers/93f60f90-a29b-4ae7-b9dc-ec821e4c7e10" status: 200 len: 1318 microversion: 2.1 time: 0.174202 Oct 29 01:30:52.193626 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 186/369] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:52 2021] GET /compute/v2.1/servers/93f60f90-a29b-4ae7-b9dc-ec821e4c7e10 => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:30:52.393658 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-fa75eaf4-5dae-40e1-80b5-ff3c709e3866 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:52.394792 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-fa75eaf4-5dae-40e1-80b5-ff3c709e3866 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:52.402225 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-fa75eaf4-5dae-40e1-80b5-ff3c709e3866 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:52.402670 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-fa75eaf4-5dae-40e1-80b5-ff3c709e3866 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:52.403530 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-fa75eaf4-5dae-40e1-80b5-ff3c709e3866 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:52.403916 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-fa75eaf4-5dae-40e1-80b5-ff3c709e3866 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:52.498534 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-fa75eaf4-5dae-40e1-80b5-ff3c709e3866 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action" status: 200 len: 28695 microversion: 2.1 time: 0.109920 Oct 29 01:30:52.499173 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 184/370] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:30:52 2021] POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action => generated 28695 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:30:52.667297 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-edb4a208-62c4-4523-92b7-67a6af352544 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:52.668059 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-edb4a208-62c4-4523-92b7-67a6af352544 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:52.675156 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-edb4a208-62c4-4523-92b7-67a6af352544 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:52.682024 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-edb4a208-62c4-4523-92b7-67a6af352544 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:52.682024 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-edb4a208-62c4-4523-92b7-67a6af352544 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:52.682024 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-edb4a208-62c4-4523-92b7-67a6af352544 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:52.747349 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-948a4120-4780-4136-9491-b916a5fec3df tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:52.748749 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-948a4120-4780-4136-9491-b916a5fec3df tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] [instance: 9f6b1af3-803b-440a-8549-e2297a014690] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:52.757511 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-948a4120-4780-4136-9491-b916a5fec3df tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:52.758558 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-948a4120-4780-4136-9491-b916a5fec3df tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:52.759512 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-948a4120-4780-4136-9491-b916a5fec3df tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:52.760149 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-948a4120-4780-4136-9491-b916a5fec3df tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:52.837272 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-edb4a208-62c4-4523-92b7-67a6af352544 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:52.846840 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-edb4a208-62c4-4523-92b7-67a6af352544 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca" status: 200 len: 1520 microversion: 2.1 time: 0.183137 Oct 29 01:30:52.848163 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 187/371] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:52 2021] GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca => generated 1520 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:52.926019 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-948a4120-4780-4136-9491-b916a5fec3df tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2dbc6652b34cd3a4fc39dbabd839bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131e8f4d098e4d2ba64328c91f63c18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:52.933728 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-948a4120-4780-4136-9491-b916a5fec3df tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] 10.222.0.87 "GET /compute/v2.1/servers/9f6b1af3-803b-440a-8549-e2297a014690" status: 200 len: 1501 microversion: 2.1 time: 0.194026 Oct 29 01:30:52.934298 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 185/372] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:52 2021] GET /compute/v2.1/servers/9f6b1af3-803b-440a-8549-e2297a014690 => generated 1501 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:30:53.116806 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-cd1ec95a-ddff-4175-883a-3783deb0c2f9 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:53.117872 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-cd1ec95a-ddff-4175-883a-3783deb0c2f9 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:53.124186 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-cd1ec95a-ddff-4175-883a-3783deb0c2f9 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:53.124652 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-cd1ec95a-ddff-4175-883a-3783deb0c2f9 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:53.126469 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-cd1ec95a-ddff-4175-883a-3783deb0c2f9 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:53.127188 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-cd1ec95a-ddff-4175-883a-3783deb0c2f9 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:53.209768 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-3af8db96-750f-4fc0-b49e-edc1c408c00d tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:53.210372 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-3af8db96-750f-4fc0-b49e-edc1c408c00d tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] [instance: 93f60f90-a29b-4ae7-b9dc-ec821e4c7e10] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:53.220657 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-3af8db96-750f-4fc0-b49e-edc1c408c00d tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:53.221187 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-3af8db96-750f-4fc0-b49e-edc1c408c00d tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:53.222279 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-3af8db96-750f-4fc0-b49e-edc1c408c00d tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:53.222714 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-3af8db96-750f-4fc0-b49e-edc1c408c00d tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:53.222824 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-cd1ec95a-ddff-4175-883a-3783deb0c2f9 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action" status: 200 len: 28671 microversion: 2.20 time: 0.109444 Oct 29 01:30:53.223799 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 188/373] 10.222.0.87 () {62 vars in 1318 bytes} [Fri Oct 29 01:30:53 2021] POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action => generated 28671 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:30:53.362564 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-3af8db96-750f-4fc0-b49e-edc1c408c00d tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ad077fd0164d3c8b4db14262186901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa66fedc6704473996d04ffbf8135e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:53.371067 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-3af8db96-750f-4fc0-b49e-edc1c408c00d tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] 10.222.0.87 "GET /compute/v2.1/servers/93f60f90-a29b-4ae7-b9dc-ec821e4c7e10" status: 200 len: 1318 microversion: 2.1 time: 0.165099 Oct 29 01:30:53.371598 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 186/374] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:53 2021] GET /compute/v2.1/servers/93f60f90-a29b-4ae7-b9dc-ec821e4c7e10 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:53.512956 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-be874d77-2854-4851-bba9-9c27e065ba90 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:53.519222 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-be874d77-2854-4851-bba9-9c27e065ba90 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:53.528635 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-be874d77-2854-4851-bba9-9c27e065ba90 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:53.529335 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-be874d77-2854-4851-bba9-9c27e065ba90 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:53.530263 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-be874d77-2854-4851-bba9-9c27e065ba90 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:53.531833 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-be874d77-2854-4851-bba9-9c27e065ba90 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:53.645742 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-be874d77-2854-4851-bba9-9c27e065ba90 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action" status: 200 len: 28695 microversion: 2.1 time: 0.138278 Oct 29 01:30:53.647058 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 189/375] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:30:53 2021] POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action => generated 28695 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:30:53.864508 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-fe59ca9c-4aca-4347-aae7-8b8633c46628 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:53.865126 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-fe59ca9c-4aca-4347-aae7-8b8633c46628 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:53.878017 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-fe59ca9c-4aca-4347-aae7-8b8633c46628 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:53.878017 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-fe59ca9c-4aca-4347-aae7-8b8633c46628 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:53.878017 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-fe59ca9c-4aca-4347-aae7-8b8633c46628 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:53.878017 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-fe59ca9c-4aca-4347-aae7-8b8633c46628 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:53.954654 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-3107aa68-49e0-4c7e-b153-c4f5ca48f7ac tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:53.955511 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-3107aa68-49e0-4c7e-b153-c4f5ca48f7ac tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] [instance: 9f6b1af3-803b-440a-8549-e2297a014690] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:53.962768 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-3107aa68-49e0-4c7e-b153-c4f5ca48f7ac tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:53.966449 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-3107aa68-49e0-4c7e-b153-c4f5ca48f7ac tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:53.966449 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-3107aa68-49e0-4c7e-b153-c4f5ca48f7ac tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:53.966449 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-3107aa68-49e0-4c7e-b153-c4f5ca48f7ac tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:54.113957 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-fe59ca9c-4aca-4347-aae7-8b8633c46628 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:54.126638 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-fe59ca9c-4aca-4347-aae7-8b8633c46628 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca" status: 200 len: 1520 microversion: 2.1 time: 0.262368 Oct 29 01:30:54.126638 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 187/376] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:53 2021] GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca => generated 1520 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:30:54.165717 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-3107aa68-49e0-4c7e-b153-c4f5ca48f7ac tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2dbc6652b34cd3a4fc39dbabd839bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131e8f4d098e4d2ba64328c91f63c18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:54.175336 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-3107aa68-49e0-4c7e-b153-c4f5ca48f7ac tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] 10.222.0.87 "GET /compute/v2.1/servers/9f6b1af3-803b-440a-8549-e2297a014690" status: 200 len: 1501 microversion: 2.1 time: 0.226162 Oct 29 01:30:54.175944 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 190/377] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:53 2021] GET /compute/v2.1/servers/9f6b1af3-803b-440a-8549-e2297a014690 => generated 1501 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:54.239388 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-07a53154-bdba-4cc7-8237-879a0ddfb627 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:54.241995 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-07a53154-bdba-4cc7-8237-879a0ddfb627 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:54.257333 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-07a53154-bdba-4cc7-8237-879a0ddfb627 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:54.257777 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-07a53154-bdba-4cc7-8237-879a0ddfb627 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:54.259571 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-07a53154-bdba-4cc7-8237-879a0ddfb627 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:54.260188 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-07a53154-bdba-4cc7-8237-879a0ddfb627 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:54.364411 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-07a53154-bdba-4cc7-8237-879a0ddfb627 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action" status: 200 len: 28671 microversion: 2.20 time: 0.131646 Oct 29 01:30:54.369219 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 188/378] 10.222.0.87 () {62 vars in 1318 bytes} [Fri Oct 29 01:30:54 2021] POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action => generated 28671 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:30:54.388547 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-d248b003-8824-4e0b-a8aa-a12855086db8 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:54.389501 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-d248b003-8824-4e0b-a8aa-a12855086db8 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] [instance: 93f60f90-a29b-4ae7-b9dc-ec821e4c7e10] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:54.404603 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-d248b003-8824-4e0b-a8aa-a12855086db8 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:54.405706 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-d248b003-8824-4e0b-a8aa-a12855086db8 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:54.408230 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-d248b003-8824-4e0b-a8aa-a12855086db8 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:54.409429 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-d248b003-8824-4e0b-a8aa-a12855086db8 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:54.654846 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-d248b003-8824-4e0b-a8aa-a12855086db8 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ad077fd0164d3c8b4db14262186901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa66fedc6704473996d04ffbf8135e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:54.659278 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-6071cfa9-ebbd-469d-83a9-94c431504b5e tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:54.660733 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-6071cfa9-ebbd-469d-83a9-94c431504b5e tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:54.667946 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-d248b003-8824-4e0b-a8aa-a12855086db8 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] 10.222.0.87 "GET /compute/v2.1/servers/93f60f90-a29b-4ae7-b9dc-ec821e4c7e10" status: 200 len: 1318 microversion: 2.1 time: 0.283680 Oct 29 01:30:54.669235 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 191/379] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:54 2021] GET /compute/v2.1/servers/93f60f90-a29b-4ae7-b9dc-ec821e4c7e10 => generated 1318 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:54.672159 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-6071cfa9-ebbd-469d-83a9-94c431504b5e tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:54.672960 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-6071cfa9-ebbd-469d-83a9-94c431504b5e tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:54.676971 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-6071cfa9-ebbd-469d-83a9-94c431504b5e tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:54.676971 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-6071cfa9-ebbd-469d-83a9-94c431504b5e tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:54.762853 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-6071cfa9-ebbd-469d-83a9-94c431504b5e tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action" status: 200 len: 28695 microversion: 2.1 time: 0.108593 Oct 29 01:30:54.763594 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 189/380] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:30:54 2021] POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action => generated 28695 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 01:30:55.014060 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [req-86f31fd2-9361-46cf-a44d-930821b0eb8c req-a4ec2e09-6230-4f3e-9ac4-b739c863da51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f6b1af3-803b-440a-8549-e2297a014690", "name": "network-vif-deleted", "tag": "43b88bbd-d6d8-4749-9d83-4e72f57efb8c"}]} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:55.017154 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:30:55.017154 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: warnings.warn(msg) Oct 29 01:30:55.036145 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [req-86f31fd2-9361-46cf-a44d-930821b0eb8c req-a4ec2e09-6230-4f3e-9ac4-b739c863da51 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:55.037793 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [req-86f31fd2-9361-46cf-a44d-930821b0eb8c req-a4ec2e09-6230-4f3e-9ac4-b739c863da51 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:55.075627 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.compute.server_external_events [req-86f31fd2-9361-46cf-a44d-930821b0eb8c req-a4ec2e09-6230-4f3e-9ac4-b739c863da51 service nova] Creating event network-vif-deleted:43b88bbd-d6d8-4749-9d83-4e72f57efb8c for instance 9f6b1af3-803b-440a-8549-e2297a014690 on hv-cinder-81398 Oct 29 01:30:55.082919 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [req-86f31fd2-9361-46cf-a44d-930821b0eb8c req-a4ec2e09-6230-4f3e-9ac4-b739c863da51 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080729 Oct 29 01:30:55.083525 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 192/381] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Oct 29 01:30:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:30:55.140150 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-9d6b7086-485d-4eed-81a2-97a2e2d25b0c tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:55.140964 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-9d6b7086-485d-4eed-81a2-97a2e2d25b0c tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:55.148152 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-9d6b7086-485d-4eed-81a2-97a2e2d25b0c tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:55.148675 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-9d6b7086-485d-4eed-81a2-97a2e2d25b0c tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:55.149479 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-9d6b7086-485d-4eed-81a2-97a2e2d25b0c tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:55.149902 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-9d6b7086-485d-4eed-81a2-97a2e2d25b0c tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:55.193394 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-dd7f4fad-25dc-4080-8980-1c0e2b9ea88e tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:55.194720 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-dd7f4fad-25dc-4080-8980-1c0e2b9ea88e tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] [instance: 9f6b1af3-803b-440a-8549-e2297a014690] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:55.201392 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-dd7f4fad-25dc-4080-8980-1c0e2b9ea88e tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:55.202461 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-dd7f4fad-25dc-4080-8980-1c0e2b9ea88e tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:55.202604 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-dd7f4fad-25dc-4080-8980-1c0e2b9ea88e tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:55.203773 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-dd7f4fad-25dc-4080-8980-1c0e2b9ea88e tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:55.355700 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-dd7f4fad-25dc-4080-8980-1c0e2b9ea88e tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2dbc6652b34cd3a4fc39dbabd839bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131e8f4d098e4d2ba64328c91f63c18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:55.365255 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-dd7f4fad-25dc-4080-8980-1c0e2b9ea88e tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] 10.222.0.87 "GET /compute/v2.1/servers/9f6b1af3-803b-440a-8549-e2297a014690" status: 200 len: 1459 microversion: 2.1 time: 0.176202 Oct 29 01:30:55.366379 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 193/382] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:55 2021] GET /compute/v2.1/servers/9f6b1af3-803b-440a-8549-e2297a014690 => generated 1459 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:30:55.383446 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-5ba21cbe-7859-4c90-968e-e4adbb751dd8 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:55.384873 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-5ba21cbe-7859-4c90-968e-e4adbb751dd8 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:55.395388 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-5ba21cbe-7859-4c90-968e-e4adbb751dd8 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:55.396144 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-5ba21cbe-7859-4c90-968e-e4adbb751dd8 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:55.397213 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-5ba21cbe-7859-4c90-968e-e4adbb751dd8 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:55.398074 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-5ba21cbe-7859-4c90-968e-e4adbb751dd8 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:55.414763 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-9d6b7086-485d-4eed-81a2-97a2e2d25b0c tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:55.431229 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-9d6b7086-485d-4eed-81a2-97a2e2d25b0c tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca" status: 200 len: 1520 microversion: 2.1 time: 0.292266 Oct 29 01:30:55.432906 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 190/383] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:55 2021] GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca => generated 1520 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:55.506416 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-5ba21cbe-7859-4c90-968e-e4adbb751dd8 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action" status: 200 len: 28671 microversion: 2.20 time: 0.132534 Oct 29 01:30:55.511955 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 194/384] 10.222.0.87 () {62 vars in 1318 bytes} [Fri Oct 29 01:30:55 2021] POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action => generated 28671 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:30:55.685205 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-834c0004-37a7-4002-9e73-490ead02c251 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:55.685867 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-834c0004-37a7-4002-9e73-490ead02c251 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] [instance: 93f60f90-a29b-4ae7-b9dc-ec821e4c7e10] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:55.693772 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-834c0004-37a7-4002-9e73-490ead02c251 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:55.694421 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-834c0004-37a7-4002-9e73-490ead02c251 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:55.695372 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-834c0004-37a7-4002-9e73-490ead02c251 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:55.695985 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-834c0004-37a7-4002-9e73-490ead02c251 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:55.784626 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-24099b3b-295f-4f11-ab80-17f628996ad0 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:55.786169 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-24099b3b-295f-4f11-ab80-17f628996ad0 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:55.824973 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-24099b3b-295f-4f11-ab80-17f628996ad0 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:55.825483 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-24099b3b-295f-4f11-ab80-17f628996ad0 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:55.826373 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-24099b3b-295f-4f11-ab80-17f628996ad0 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:55.826801 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-24099b3b-295f-4f11-ab80-17f628996ad0 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:55.873152 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-834c0004-37a7-4002-9e73-490ead02c251 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ad077fd0164d3c8b4db14262186901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa66fedc6704473996d04ffbf8135e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:55.881430 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-834c0004-37a7-4002-9e73-490ead02c251 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] 10.222.0.87 "GET /compute/v2.1/servers/93f60f90-a29b-4ae7-b9dc-ec821e4c7e10" status: 200 len: 1318 microversion: 2.1 time: 0.199791 Oct 29 01:30:55.885711 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 191/385] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:55 2021] GET /compute/v2.1/servers/93f60f90-a29b-4ae7-b9dc-ec821e4c7e10 => generated 1318 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:55.891366 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [req-dcbcd16a-1a82-4c2f-a326-aa21713053f8 req-a28c4cd1-61e8-4440-a229-3c94238b278a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93f60f90-a29b-4ae7-b9dc-ec821e4c7e10", "name": "network-vif-plugged", "status": "completed", "tag": "bae2e6bb-454a-4acd-acb0-022f69f3a6e8"}]} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:55.894102 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:30:55.894102 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: warnings.warn(msg) Oct 29 01:30:55.909279 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-24099b3b-295f-4f11-ab80-17f628996ad0 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action" status: 200 len: 28695 microversion: 2.1 time: 0.138124 Oct 29 01:30:55.910613 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 195/386] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:30:55 2021] POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action => generated 28695 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:30:55.914333 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [req-dcbcd16a-1a82-4c2f-a326-aa21713053f8 req-a28c4cd1-61e8-4440-a229-3c94238b278a service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:55.915000 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [req-dcbcd16a-1a82-4c2f-a326-aa21713053f8 req-a28c4cd1-61e8-4440-a229-3c94238b278a service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:55.927421 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.compute.server_external_events [req-dcbcd16a-1a82-4c2f-a326-aa21713053f8 req-a28c4cd1-61e8-4440-a229-3c94238b278a service nova] Creating event network-vif-plugged:bae2e6bb-454a-4acd-acb0-022f69f3a6e8 for instance 93f60f90-a29b-4ae7-b9dc-ec821e4c7e10 on hv-cinder-81398 Oct 29 01:30:55.932619 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [req-dcbcd16a-1a82-4c2f-a326-aa21713053f8 req-a28c4cd1-61e8-4440-a229-3c94238b278a service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045559 Oct 29 01:30:55.933593 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 192/387] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Oct 29 01:30:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:30:56.382732 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-6a5527fa-b7f8-4dcd-a2dc-d8586c3e4217 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:56.384870 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-6a5527fa-b7f8-4dcd-a2dc-d8586c3e4217 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] [instance: 9f6b1af3-803b-440a-8549-e2297a014690] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:56.393753 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-6a5527fa-b7f8-4dcd-a2dc-d8586c3e4217 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:56.395616 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-6a5527fa-b7f8-4dcd-a2dc-d8586c3e4217 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:56.396697 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-6a5527fa-b7f8-4dcd-a2dc-d8586c3e4217 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:56.397886 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-6a5527fa-b7f8-4dcd-a2dc-d8586c3e4217 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:56.459592 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-8f713554-7ce5-4b8c-ac2b-2fe54fe64e99 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:56.461882 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-8f713554-7ce5-4b8c-ac2b-2fe54fe64e99 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:56.480119 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-8f713554-7ce5-4b8c-ac2b-2fe54fe64e99 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:56.483958 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-8f713554-7ce5-4b8c-ac2b-2fe54fe64e99 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:56.483958 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-8f713554-7ce5-4b8c-ac2b-2fe54fe64e99 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:56.483958 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-8f713554-7ce5-4b8c-ac2b-2fe54fe64e99 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:56.493566 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-6a5527fa-b7f8-4dcd-a2dc-d8586c3e4217 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:56.496572 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-6a5527fa-b7f8-4dcd-a2dc-d8586c3e4217 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:56.497381 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.objects.instance [None req-6a5527fa-b7f8-4dcd-a2dc-d8586c3e4217 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lazy-loading 'fault' on Instance uuid 9f6b1af3-803b-440a-8549-e2297a014690 {{(pid=116378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 01:30:56.628380 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-6a5527fa-b7f8-4dcd-a2dc-d8586c3e4217 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b2dbc6652b34cd3a4fc39dbabd839bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131e8f4d098e4d2ba64328c91f63c18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:56.641820 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-6a5527fa-b7f8-4dcd-a2dc-d8586c3e4217 tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] 10.222.0.87 "GET /compute/v2.1/servers/9f6b1af3-803b-440a-8549-e2297a014690" status: 200 len: 1303 microversion: 2.1 time: 0.262969 Oct 29 01:30:56.651504 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 196/388] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:56 2021] GET /compute/v2.1/servers/9f6b1af3-803b-440a-8549-e2297a014690 => generated 1303 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:56.657713 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-a1c8ca6c-0e0e-476e-b633-5a7c4eccef83 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:56.658700 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-a1c8ca6c-0e0e-476e-b633-5a7c4eccef83 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:56.670560 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a1c8ca6c-0e0e-476e-b633-5a7c4eccef83 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:56.673269 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a1c8ca6c-0e0e-476e-b633-5a7c4eccef83 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:56.673269 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a1c8ca6c-0e0e-476e-b633-5a7c4eccef83 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:56.673269 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a1c8ca6c-0e0e-476e-b633-5a7c4eccef83 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:56.755049 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-8f713554-7ce5-4b8c-ac2b-2fe54fe64e99 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:56.762626 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-8f713554-7ce5-4b8c-ac2b-2fe54fe64e99 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca" status: 200 len: 1520 microversion: 2.1 time: 0.315570 Oct 29 01:30:56.774252 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 193/389] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:56 2021] GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca => generated 1520 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:30:56.898271 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-036e2117-a96e-408d-a97a-7e2fddce705e tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:56.899094 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-036e2117-a96e-408d-a97a-7e2fddce705e tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] [instance: 93f60f90-a29b-4ae7-b9dc-ec821e4c7e10] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:56.905380 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-036e2117-a96e-408d-a97a-7e2fddce705e tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:56.905829 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-036e2117-a96e-408d-a97a-7e2fddce705e tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:56.906777 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-036e2117-a96e-408d-a97a-7e2fddce705e tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:56.907209 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-036e2117-a96e-408d-a97a-7e2fddce705e tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:56.975812 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-a1c8ca6c-0e0e-476e-b633-5a7c4eccef83 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action" status: 200 len: 29037 microversion: 2.20 time: 0.322810 Oct 29 01:30:56.979857 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 197/390] 10.222.0.87 () {62 vars in 1318 bytes} [Fri Oct 29 01:30:56 2021] POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action => generated 29037 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:30:56.995035 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-2dfedbfb-7091-4f4c-a967-0f2c1054b7db tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:56.996293 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-2dfedbfb-7091-4f4c-a967-0f2c1054b7db tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:57.013177 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-2dfedbfb-7091-4f4c-a967-0f2c1054b7db tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:57.018364 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-2dfedbfb-7091-4f4c-a967-0f2c1054b7db tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:57.021980 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-2dfedbfb-7091-4f4c-a967-0f2c1054b7db tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:57.022471 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-2dfedbfb-7091-4f4c-a967-0f2c1054b7db tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:57.054446 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-036e2117-a96e-408d-a97a-7e2fddce705e tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ad077fd0164d3c8b4db14262186901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa66fedc6704473996d04ffbf8135e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:57.063328 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-036e2117-a96e-408d-a97a-7e2fddce705e tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] 10.222.0.87 "GET /compute/v2.1/servers/93f60f90-a29b-4ae7-b9dc-ec821e4c7e10" status: 200 len: 1318 microversion: 2.1 time: 0.168779 Oct 29 01:30:57.063942 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 194/391] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:56 2021] GET /compute/v2.1/servers/93f60f90-a29b-4ae7-b9dc-ec821e4c7e10 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:30:57.130912 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-2dfedbfb-7091-4f4c-a967-0f2c1054b7db tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action" status: 200 len: 29113 microversion: 2.1 time: 0.153103 Oct 29 01:30:57.132087 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 198/392] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:30:56 2021] POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action => generated 29113 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:30:57.658822 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-027ea0f8-579d-4063-9fff-7b51423300da tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:57.659604 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-027ea0f8-579d-4063-9fff-7b51423300da tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] [instance: 9f6b1af3-803b-440a-8549-e2297a014690] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:57.668969 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-027ea0f8-579d-4063-9fff-7b51423300da tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:57.669430 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-027ea0f8-579d-4063-9fff-7b51423300da tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:57.670753 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-027ea0f8-579d-4063-9fff-7b51423300da tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:57.671345 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-027ea0f8-579d-4063-9fff-7b51423300da tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:57.686546 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.wsgi [None req-027ea0f8-579d-4063-9fff-7b51423300da tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] HTTP exception thrown: Instance 9f6b1af3-803b-440a-8549-e2297a014690 could not be found. Oct 29 01:30:57.687168 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-027ea0f8-579d-4063-9fff-7b51423300da tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] Returning 404 to user: Instance 9f6b1af3-803b-440a-8549-e2297a014690 could not be found. {{(pid=116379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:30:57.691571 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-027ea0f8-579d-4063-9fff-7b51423300da tempest-VolumesActionsTest-1777614909 tempest-VolumesActionsTest-1777614909-project] 10.222.0.87 "GET /compute/v2.1/servers/9f6b1af3-803b-440a-8549-e2297a014690" status: 404 len: 111 microversion: 2.1 time: 0.033615 Oct 29 01:30:57.691571 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 195/393] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:57 2021] GET /compute/v2.1/servers/9f6b1af3-803b-440a-8549-e2297a014690 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:30:57.782002 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-f3c7bc31-de85-4366-9ba5-13eda694cf05 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:57.782816 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-f3c7bc31-de85-4366-9ba5-13eda694cf05 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:57.790631 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-f3c7bc31-de85-4366-9ba5-13eda694cf05 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:57.791071 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-f3c7bc31-de85-4366-9ba5-13eda694cf05 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:57.791863 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-f3c7bc31-de85-4366-9ba5-13eda694cf05 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:57.792495 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-f3c7bc31-de85-4366-9ba5-13eda694cf05 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:57.948881 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-f3c7bc31-de85-4366-9ba5-13eda694cf05 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:57.956565 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-f3c7bc31-de85-4366-9ba5-13eda694cf05 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca" status: 200 len: 1520 microversion: 2.1 time: 0.179295 Oct 29 01:30:57.957136 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 199/394] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:57 2021] GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca => generated 1520 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:57.987442 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-69dac718-afb6-44d4-b526-9863c74f50c2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:57.988482 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-69dac718-afb6-44d4-b526-9863c74f50c2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:57.994427 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-69dac718-afb6-44d4-b526-9863c74f50c2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:57.994931 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-69dac718-afb6-44d4-b526-9863c74f50c2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:57.995684 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-69dac718-afb6-44d4-b526-9863c74f50c2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:57.996137 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-69dac718-afb6-44d4-b526-9863c74f50c2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:58.081535 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-823bec83-30e8-4928-8c34-302be82208d5 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:58.084811 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-823bec83-30e8-4928-8c34-302be82208d5 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] [instance: 93f60f90-a29b-4ae7-b9dc-ec821e4c7e10] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:58.088479 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-823bec83-30e8-4928-8c34-302be82208d5 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:58.088912 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-823bec83-30e8-4928-8c34-302be82208d5 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:58.089848 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-823bec83-30e8-4928-8c34-302be82208d5 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:58.090462 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-823bec83-30e8-4928-8c34-302be82208d5 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:58.107550 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-69dac718-afb6-44d4-b526-9863c74f50c2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action" status: 200 len: 29899 microversion: 2.20 time: 0.123720 Oct 29 01:30:58.112352 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 196/395] 10.222.0.87 () {62 vars in 1318 bytes} [Fri Oct 29 01:30:57 2021] POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action => generated 29899 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:30:58.150093 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-c9a6b2da-76d9-4bee-9d38-76945e96776e tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:58.151107 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-c9a6b2da-76d9-4bee-9d38-76945e96776e tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:58.168029 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-c9a6b2da-76d9-4bee-9d38-76945e96776e tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:58.168029 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-c9a6b2da-76d9-4bee-9d38-76945e96776e tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:58.169151 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-c9a6b2da-76d9-4bee-9d38-76945e96776e tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:58.169855 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-c9a6b2da-76d9-4bee-9d38-76945e96776e tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:58.288155 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-823bec83-30e8-4928-8c34-302be82208d5 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ad077fd0164d3c8b4db14262186901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa66fedc6704473996d04ffbf8135e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:58.298170 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-823bec83-30e8-4928-8c34-302be82208d5 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] 10.222.0.87 "GET /compute/v2.1/servers/93f60f90-a29b-4ae7-b9dc-ec821e4c7e10" status: 200 len: 1318 microversion: 2.1 time: 0.219595 Oct 29 01:30:58.298752 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 200/396] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:58 2021] GET /compute/v2.1/servers/93f60f90-a29b-4ae7-b9dc-ec821e4c7e10 => generated 1318 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:58.343854 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-c9a6b2da-76d9-4bee-9d38-76945e96776e tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action" status: 200 len: 30090 microversion: 2.1 time: 0.204309 Oct 29 01:30:58.347760 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 197/397] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:30:58 2021] POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action => generated 30090 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 01:30:58.974641 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-10ef5362-5f4f-4265-9acc-27e22250f274 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:58.975294 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-10ef5362-5f4f-4265-9acc-27e22250f274 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:58.981648 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-10ef5362-5f4f-4265-9acc-27e22250f274 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:58.982096 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-10ef5362-5f4f-4265-9acc-27e22250f274 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:58.982937 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-10ef5362-5f4f-4265-9acc-27e22250f274 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:58.983367 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-10ef5362-5f4f-4265-9acc-27e22250f274 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:59.126967 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-9c50ae8e-427c-484e-bbf0-a8b9b9ea62ca tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:59.129143 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-9c50ae8e-427c-484e-bbf0-a8b9b9ea62ca tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:59.136146 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-9c50ae8e-427c-484e-bbf0-a8b9b9ea62ca tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:59.136966 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-9c50ae8e-427c-484e-bbf0-a8b9b9ea62ca tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:59.140977 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-9c50ae8e-427c-484e-bbf0-a8b9b9ea62ca tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:59.141650 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-9c50ae8e-427c-484e-bbf0-a8b9b9ea62ca tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:59.164931 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-10ef5362-5f4f-4265-9acc-27e22250f274 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:59.170886 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-10ef5362-5f4f-4265-9acc-27e22250f274 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca" status: 200 len: 1520 microversion: 2.1 time: 0.199932 Oct 29 01:30:59.176223 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 201/398] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:58 2021] GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca => generated 1520 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:30:59.316069 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-8f7b627a-5740-4557-b418-e35ce76fd968 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:30:59.316680 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-8f7b627a-5740-4557-b418-e35ce76fd968 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] [instance: 93f60f90-a29b-4ae7-b9dc-ec821e4c7e10] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:59.322948 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-8f7b627a-5740-4557-b418-e35ce76fd968 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:59.323527 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-8f7b627a-5740-4557-b418-e35ce76fd968 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:59.324224 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-8f7b627a-5740-4557-b418-e35ce76fd968 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:59.324906 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-8f7b627a-5740-4557-b418-e35ce76fd968 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:59.477808 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-8f7b627a-5740-4557-b418-e35ce76fd968 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ad077fd0164d3c8b4db14262186901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa66fedc6704473996d04ffbf8135e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:30:59.486377 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-8f7b627a-5740-4557-b418-e35ce76fd968 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] 10.222.0.87 "GET /compute/v2.1/servers/93f60f90-a29b-4ae7-b9dc-ec821e4c7e10" status: 200 len: 1506 microversion: 2.1 time: 0.174927 Oct 29 01:30:59.487109 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 202/399] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:30:59 2021] GET /compute/v2.1/servers/93f60f90-a29b-4ae7-b9dc-ec821e4c7e10 => generated 1506 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:30:59.493793 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-aa1bedb6-bf72-432d-b468-5789a00e4a71 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:30:59.495183 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-aa1bedb6-bf72-432d-b468-5789a00e4a71 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:30:59.505126 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-aa1bedb6-bf72-432d-b468-5789a00e4a71 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:59.505962 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-aa1bedb6-bf72-432d-b468-5789a00e4a71 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:30:59.506847 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-aa1bedb6-bf72-432d-b468-5789a00e4a71 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:30:59.507353 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-aa1bedb6-bf72-432d-b468-5789a00e4a71 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:02.359690 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-aa1bedb6-bf72-432d-b468-5789a00e4a71 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action" status: 200 len: 32931 microversion: 2.1 time: 2.870402 Oct 29 01:31:02.364012 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 203/400] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:30:59 2021] POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action => generated 32931 bytes in 2873 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:31:02.365505 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-e80252b8-efa3-43fc-aa3c-0c78aec4100c tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:02.366295 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-e80252b8-efa3-43fc-aa3c-0c78aec4100c tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:02.373520 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-e80252b8-efa3-43fc-aa3c-0c78aec4100c tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:02.373965 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-e80252b8-efa3-43fc-aa3c-0c78aec4100c tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:02.374741 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-e80252b8-efa3-43fc-aa3c-0c78aec4100c tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:02.375841 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-e80252b8-efa3-43fc-aa3c-0c78aec4100c tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:02.389934 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-9c50ae8e-427c-484e-bbf0-a8b9b9ea62ca tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action" status: 200 len: 32800 microversion: 2.20 time: 3.273939 Oct 29 01:31:02.391422 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 198/401] 10.222.0.87 () {62 vars in 1318 bytes} [Fri Oct 29 01:30:59 2021] POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action => generated 32800 bytes in 3277 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 29 01:31:02.544556 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-e80252b8-efa3-43fc-aa3c-0c78aec4100c tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:02.554163 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-e80252b8-efa3-43fc-aa3c-0c78aec4100c tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca" status: 200 len: 1520 microversion: 2.1 time: 0.192490 Oct 29 01:31:02.554795 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 204/402] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:31:02 2021] GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca => generated 1520 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:31:03.372029 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-d28b28fe-1cdb-4413-a3a5-31a8f85c3f9d tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:31:03.373033 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-d28b28fe-1cdb-4413-a3a5-31a8f85c3f9d tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:03.382437 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d28b28fe-1cdb-4413-a3a5-31a8f85c3f9d tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:03.384608 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d28b28fe-1cdb-4413-a3a5-31a8f85c3f9d tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:03.384608 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d28b28fe-1cdb-4413-a3a5-31a8f85c3f9d tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:03.384608 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d28b28fe-1cdb-4413-a3a5-31a8f85c3f9d tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:03.402707 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-51456402-12b8-4215-bea7-b725a6ffc70a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:31:03.404301 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-51456402-12b8-4215-bea7-b725a6ffc70a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:03.410745 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-51456402-12b8-4215-bea7-b725a6ffc70a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:03.413347 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-51456402-12b8-4215-bea7-b725a6ffc70a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:03.413347 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-51456402-12b8-4215-bea7-b725a6ffc70a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:03.413347 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-51456402-12b8-4215-bea7-b725a6ffc70a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:05.788785 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-d28b28fe-1cdb-4413-a3a5-31a8f85c3f9d tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action" status: 200 len: 34489 microversion: 2.1 time: 2.420457 Oct 29 01:31:05.789383 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 199/403] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:31:03 2021] POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action => generated 34489 bytes in 2422 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:31:05.795691 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-5e185cfb-76c8-45f7-b886-f83a4216c3ba tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:05.796403 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-5e185cfb-76c8-45f7-b886-f83a4216c3ba tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:05.804633 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-5e185cfb-76c8-45f7-b886-f83a4216c3ba tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:05.805130 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-5e185cfb-76c8-45f7-b886-f83a4216c3ba tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:05.806160 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-5e185cfb-76c8-45f7-b886-f83a4216c3ba tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:05.806593 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-5e185cfb-76c8-45f7-b886-f83a4216c3ba tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:05.808349 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-51456402-12b8-4215-bea7-b725a6ffc70a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action" status: 200 len: 34629 microversion: 2.20 time: 2.409253 Oct 29 01:31:05.812406 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 205/404] 10.222.0.87 () {62 vars in 1318 bytes} [Fri Oct 29 01:31:03 2021] POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action => generated 34629 bytes in 2411 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 29 01:31:05.932636 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-5e185cfb-76c8-45f7-b886-f83a4216c3ba tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:05.940023 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-5e185cfb-76c8-45f7-b886-f83a4216c3ba tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca" status: 200 len: 1520 microversion: 2.1 time: 0.148823 Oct 29 01:31:05.940602 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 200/405] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:31:05 2021] GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:31:06.802025 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-95f71220-9f73-41e2-8972-11c5473857a4 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:31:06.803028 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-95f71220-9f73-41e2-8972-11c5473857a4 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:06.810173 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-95f71220-9f73-41e2-8972-11c5473857a4 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:06.810848 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-95f71220-9f73-41e2-8972-11c5473857a4 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:06.811400 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-95f71220-9f73-41e2-8972-11c5473857a4 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:06.812043 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-95f71220-9f73-41e2-8972-11c5473857a4 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:06.821469 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-6533dd6d-38b7-41fd-ac3b-11f3bf95dedd tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:31:06.823431 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-6533dd6d-38b7-41fd-ac3b-11f3bf95dedd tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:06.831819 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-6533dd6d-38b7-41fd-ac3b-11f3bf95dedd tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:06.837307 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-6533dd6d-38b7-41fd-ac3b-11f3bf95dedd tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:06.837307 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-6533dd6d-38b7-41fd-ac3b-11f3bf95dedd tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:06.837307 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-6533dd6d-38b7-41fd-ac3b-11f3bf95dedd tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:06.898098 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-95f71220-9f73-41e2-8972-11c5473857a4 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action" status: 200 len: 34974 microversion: 2.1 time: 0.100597 Oct 29 01:31:06.898750 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 206/406] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:31:06 2021] POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action => generated 34974 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:31:06.929661 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-6533dd6d-38b7-41fd-ac3b-11f3bf95dedd tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action" status: 200 len: 35193 microversion: 2.20 time: 0.112040 Oct 29 01:31:06.930306 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 201/407] 10.222.0.87 () {62 vars in 1318 bytes} [Fri Oct 29 01:31:06 2021] POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action => generated 35193 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 29 01:31:06.958167 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-6c702a26-6d0f-40fc-b395-2c8b5891d57a tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:06.958860 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-6c702a26-6d0f-40fc-b395-2c8b5891d57a tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:06.965958 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-6c702a26-6d0f-40fc-b395-2c8b5891d57a tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:06.966399 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-6c702a26-6d0f-40fc-b395-2c8b5891d57a tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:06.967202 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-6c702a26-6d0f-40fc-b395-2c8b5891d57a tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:06.967625 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-6c702a26-6d0f-40fc-b395-2c8b5891d57a tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:07.101280 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-6c702a26-6d0f-40fc-b395-2c8b5891d57a tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:07.108751 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-6c702a26-6d0f-40fc-b395-2c8b5891d57a tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca" status: 200 len: 1520 microversion: 2.1 time: 0.155561 Oct 29 01:31:07.109303 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 207/408] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:31:06 2021] GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:31:07.910840 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-c81b347b-e545-41a0-ae6d-c96d57fafedb tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:31:07.912598 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-c81b347b-e545-41a0-ae6d-c96d57fafedb tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:07.920483 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-c81b347b-e545-41a0-ae6d-c96d57fafedb tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:07.920936 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-c81b347b-e545-41a0-ae6d-c96d57fafedb tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:07.921720 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-c81b347b-e545-41a0-ae6d-c96d57fafedb tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:07.922817 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-c81b347b-e545-41a0-ae6d-c96d57fafedb tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:07.943989 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-4d264d07-4be2-4e76-9041-e50ba41aef98 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:31:07.946220 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-4d264d07-4be2-4e76-9041-e50ba41aef98 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:07.953820 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4d264d07-4be2-4e76-9041-e50ba41aef98 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:07.954337 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4d264d07-4be2-4e76-9041-e50ba41aef98 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:07.955637 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4d264d07-4be2-4e76-9041-e50ba41aef98 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:07.956414 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4d264d07-4be2-4e76-9041-e50ba41aef98 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:08.008400 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-c81b347b-e545-41a0-ae6d-c96d57fafedb tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action" status: 200 len: 35483 microversion: 2.1 time: 0.100060 Oct 29 01:31:08.008400 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 202/409] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:31:07 2021] POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action => generated 35483 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:31:08.057455 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-4d264d07-4be2-4e76-9041-e50ba41aef98 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action" status: 200 len: 35778 microversion: 2.20 time: 0.118907 Oct 29 01:31:08.059274 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 208/410] 10.222.0.87 () {62 vars in 1318 bytes} [Fri Oct 29 01:31:07 2021] POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action => generated 35778 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 29 01:31:08.127023 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-08c3ff0c-f8be-4a47-8306-1be4f848a5d5 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:08.129373 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-08c3ff0c-f8be-4a47-8306-1be4f848a5d5 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:08.137144 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-08c3ff0c-f8be-4a47-8306-1be4f848a5d5 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:08.137862 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-08c3ff0c-f8be-4a47-8306-1be4f848a5d5 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:08.140664 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-08c3ff0c-f8be-4a47-8306-1be4f848a5d5 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:08.140664 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-08c3ff0c-f8be-4a47-8306-1be4f848a5d5 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:08.314735 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-08c3ff0c-f8be-4a47-8306-1be4f848a5d5 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:08.326346 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-08c3ff0c-f8be-4a47-8306-1be4f848a5d5 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca" status: 200 len: 1520 microversion: 2.1 time: 0.204172 Oct 29 01:31:08.339530 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 203/411] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:31:08 2021] GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca => generated 1520 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:31:09.022446 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-7a8d661e-724c-4b52-87ad-6f0db5fb788f tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:31:09.024153 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-7a8d661e-724c-4b52-87ad-6f0db5fb788f tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:09.035368 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-7a8d661e-724c-4b52-87ad-6f0db5fb788f tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:09.035368 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-7a8d661e-724c-4b52-87ad-6f0db5fb788f tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:09.035368 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-7a8d661e-724c-4b52-87ad-6f0db5fb788f tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:09.035368 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-7a8d661e-724c-4b52-87ad-6f0db5fb788f tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:09.079839 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-9570efc6-53c9-4418-ba30-2bd596679c30 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:31:09.083395 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-9570efc6-53c9-4418-ba30-2bd596679c30 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:09.101607 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-9570efc6-53c9-4418-ba30-2bd596679c30 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:09.102398 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-9570efc6-53c9-4418-ba30-2bd596679c30 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:09.103521 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-9570efc6-53c9-4418-ba30-2bd596679c30 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:09.104219 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-9570efc6-53c9-4418-ba30-2bd596679c30 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:09.157196 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-7a8d661e-724c-4b52-87ad-6f0db5fb788f tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action" status: 200 len: 36224 microversion: 2.1 time: 0.141414 Oct 29 01:31:09.168016 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 209/412] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:31:09 2021] POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action => generated 36224 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:31:09.218008 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-9570efc6-53c9-4418-ba30-2bd596679c30 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action" status: 200 len: 36554 microversion: 2.20 time: 0.150455 Oct 29 01:31:09.218897 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 204/413] 10.222.0.87 () {62 vars in 1318 bytes} [Fri Oct 29 01:31:09 2021] POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action => generated 36554 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:31:09.366211 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-44925de0-9cbe-46e4-926e-0750fbc8f533 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:09.367177 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-44925de0-9cbe-46e4-926e-0750fbc8f533 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:09.374073 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-44925de0-9cbe-46e4-926e-0750fbc8f533 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:09.374587 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-44925de0-9cbe-46e4-926e-0750fbc8f533 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:09.375398 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-44925de0-9cbe-46e4-926e-0750fbc8f533 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:09.375785 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-44925de0-9cbe-46e4-926e-0750fbc8f533 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:09.515336 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-44925de0-9cbe-46e4-926e-0750fbc8f533 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:09.534323 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-44925de0-9cbe-46e4-926e-0750fbc8f533 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca" status: 200 len: 1520 microversion: 2.1 time: 0.171391 Oct 29 01:31:09.550351 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 210/414] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:31:09 2021] GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca => generated 1520 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:31:10.182902 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-e2977784-eb05-4a03-867a-71d1c08ba6b9 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:31:10.185807 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-e2977784-eb05-4a03-867a-71d1c08ba6b9 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:10.195378 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-e2977784-eb05-4a03-867a-71d1c08ba6b9 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:10.196157 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-e2977784-eb05-4a03-867a-71d1c08ba6b9 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:10.197048 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-e2977784-eb05-4a03-867a-71d1c08ba6b9 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:10.197901 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-e2977784-eb05-4a03-867a-71d1c08ba6b9 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:10.230697 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-a7c62674-d51c-4f28-b3b6-6bbbcb7f61ad tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:31:10.232040 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-a7c62674-d51c-4f28-b3b6-6bbbcb7f61ad tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:10.242888 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a7c62674-d51c-4f28-b3b6-6bbbcb7f61ad tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:10.243364 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a7c62674-d51c-4f28-b3b6-6bbbcb7f61ad tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:10.244202 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a7c62674-d51c-4f28-b3b6-6bbbcb7f61ad tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:10.244627 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a7c62674-d51c-4f28-b3b6-6bbbcb7f61ad tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:10.309424 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-e2977784-eb05-4a03-867a-71d1c08ba6b9 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action" status: 200 len: 36922 microversion: 2.1 time: 0.131687 Oct 29 01:31:10.310074 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 205/415] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:31:10 2021] POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action => generated 36922 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:31:10.364074 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-a7c62674-d51c-4f28-b3b6-6bbbcb7f61ad tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action" status: 200 len: 37244 microversion: 2.20 time: 0.136552 Oct 29 01:31:10.365436 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 211/416] 10.222.0.87 () {62 vars in 1318 bytes} [Fri Oct 29 01:31:10 2021] POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action => generated 37244 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 29 01:31:10.557859 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-3aa8ca49-a504-4b8b-af71-7cfa94cb4b6c tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:10.558885 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-3aa8ca49-a504-4b8b-af71-7cfa94cb4b6c tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:10.568731 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-3aa8ca49-a504-4b8b-af71-7cfa94cb4b6c tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:10.569620 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-3aa8ca49-a504-4b8b-af71-7cfa94cb4b6c tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:10.572174 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-3aa8ca49-a504-4b8b-af71-7cfa94cb4b6c tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:10.572841 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-3aa8ca49-a504-4b8b-af71-7cfa94cb4b6c tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:10.756840 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-3aa8ca49-a504-4b8b-af71-7cfa94cb4b6c tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:10.764754 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-3aa8ca49-a504-4b8b-af71-7cfa94cb4b6c tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca" status: 200 len: 1520 microversion: 2.1 time: 0.211260 Oct 29 01:31:10.775883 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 206/417] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:31:10 2021] GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca => generated 1520 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:31:11.324571 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-831fe545-741d-44f5-b997-1af97e2227c8 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:31:11.331093 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-831fe545-741d-44f5-b997-1af97e2227c8 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:11.339074 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-831fe545-741d-44f5-b997-1af97e2227c8 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:11.339520 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-831fe545-741d-44f5-b997-1af97e2227c8 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:11.340534 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-831fe545-741d-44f5-b997-1af97e2227c8 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:11.341130 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-831fe545-741d-44f5-b997-1af97e2227c8 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:11.380503 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-9783d515-532e-448b-bf37-acba1b029e82 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:31:11.381585 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-9783d515-532e-448b-bf37-acba1b029e82 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:11.393016 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-9783d515-532e-448b-bf37-acba1b029e82 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:11.396990 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-9783d515-532e-448b-bf37-acba1b029e82 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:11.396990 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-9783d515-532e-448b-bf37-acba1b029e82 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:11.396990 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-9783d515-532e-448b-bf37-acba1b029e82 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:11.470103 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-831fe545-741d-44f5-b997-1af97e2227c8 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action" status: 200 len: 37725 microversion: 2.1 time: 0.150857 Oct 29 01:31:11.470873 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 212/418] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:31:11 2021] POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action => generated 37725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:31:11.499235 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-9783d515-532e-448b-bf37-acba1b029e82 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action" status: 200 len: 37947 microversion: 2.20 time: 0.123661 Oct 29 01:31:11.506327 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 207/419] 10.222.0.87 () {62 vars in 1318 bytes} [Fri Oct 29 01:31:11 2021] POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action => generated 37947 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:31:11.782961 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-d6b71573-7417-4fa7-8a58-7b59b4ec7b88 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:11.784232 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-d6b71573-7417-4fa7-8a58-7b59b4ec7b88 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:11.791150 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-d6b71573-7417-4fa7-8a58-7b59b4ec7b88 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:11.791606 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-d6b71573-7417-4fa7-8a58-7b59b4ec7b88 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:11.792435 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-d6b71573-7417-4fa7-8a58-7b59b4ec7b88 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:11.793044 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-d6b71573-7417-4fa7-8a58-7b59b4ec7b88 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:11.952453 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-d6b71573-7417-4fa7-8a58-7b59b4ec7b88 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:11.961092 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-d6b71573-7417-4fa7-8a58-7b59b4ec7b88 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca" status: 200 len: 1520 microversion: 2.1 time: 0.182127 Oct 29 01:31:11.961637 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 213/420] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:31:11 2021] GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca => generated 1520 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:31:12.483280 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-f606ca74-706b-4629-89bb-e8900ec13800 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:31:12.484486 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-f606ca74-706b-4629-89bb-e8900ec13800 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:12.492660 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-f606ca74-706b-4629-89bb-e8900ec13800 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:12.493120 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-f606ca74-706b-4629-89bb-e8900ec13800 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:12.494177 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-f606ca74-706b-4629-89bb-e8900ec13800 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:12.494659 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-f606ca74-706b-4629-89bb-e8900ec13800 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:12.515055 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-e54ab4d9-0c62-4050-a188-522f3391b4e0 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:31:12.519054 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-e54ab4d9-0c62-4050-a188-522f3391b4e0 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:12.532593 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-e54ab4d9-0c62-4050-a188-522f3391b4e0 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:12.533463 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-e54ab4d9-0c62-4050-a188-522f3391b4e0 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:12.535082 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-e54ab4d9-0c62-4050-a188-522f3391b4e0 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:12.535694 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-e54ab4d9-0c62-4050-a188-522f3391b4e0 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:12.597312 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-f606ca74-706b-4629-89bb-e8900ec13800 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action" status: 200 len: 38201 microversion: 2.1 time: 0.117658 Oct 29 01:31:12.598404 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 208/421] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:31:12 2021] POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action => generated 38201 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:31:12.656144 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-e54ab4d9-0c62-4050-a188-522f3391b4e0 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action" status: 200 len: 38196 microversion: 2.20 time: 0.146418 Oct 29 01:31:12.665307 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 214/422] 10.222.0.87 () {62 vars in 1318 bytes} [Fri Oct 29 01:31:12 2021] POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action => generated 38196 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:31:12.980039 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-c0126ee6-64c9-4806-a3e6-f7c131481f66 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:12.980956 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-c0126ee6-64c9-4806-a3e6-f7c131481f66 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:12.993786 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-c0126ee6-64c9-4806-a3e6-f7c131481f66 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:12.994364 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-c0126ee6-64c9-4806-a3e6-f7c131481f66 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:12.995009 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-c0126ee6-64c9-4806-a3e6-f7c131481f66 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:12.995432 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-c0126ee6-64c9-4806-a3e6-f7c131481f66 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:13.127622 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-c0126ee6-64c9-4806-a3e6-f7c131481f66 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:13.136698 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-c0126ee6-64c9-4806-a3e6-f7c131481f66 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca" status: 200 len: 1520 microversion: 2.1 time: 0.161677 Oct 29 01:31:13.137307 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 209/423] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:31:12 2021] GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:31:13.610089 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-fe25ffb9-6635-4074-9aa0-e347d2a2458a tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:31:13.611133 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-fe25ffb9-6635-4074-9aa0-e347d2a2458a tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:13.618703 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-fe25ffb9-6635-4074-9aa0-e347d2a2458a tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:13.619151 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-fe25ffb9-6635-4074-9aa0-e347d2a2458a tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:13.620125 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-fe25ffb9-6635-4074-9aa0-e347d2a2458a tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:13.620716 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-fe25ffb9-6635-4074-9aa0-e347d2a2458a tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:13.669802 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-69830fad-ba5f-44bc-8c9d-1cc15ae82386 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:31:13.671135 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-69830fad-ba5f-44bc-8c9d-1cc15ae82386 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:13.679252 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-69830fad-ba5f-44bc-8c9d-1cc15ae82386 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:13.679708 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-69830fad-ba5f-44bc-8c9d-1cc15ae82386 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:13.680497 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-69830fad-ba5f-44bc-8c9d-1cc15ae82386 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:13.680996 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-69830fad-ba5f-44bc-8c9d-1cc15ae82386 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:13.725113 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-fe25ffb9-6635-4074-9aa0-e347d2a2458a tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action" status: 200 len: 38205 microversion: 2.1 time: 0.119005 Oct 29 01:31:13.726469 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 215/424] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:31:13 2021] POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action => generated 38205 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:31:13.787891 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-69830fad-ba5f-44bc-8c9d-1cc15ae82386 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action" status: 200 len: 38196 microversion: 2.20 time: 0.122708 Oct 29 01:31:13.789529 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 210/425] 10.222.0.87 () {62 vars in 1318 bytes} [Fri Oct 29 01:31:13 2021] POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action => generated 38196 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 29 01:31:14.198339 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-d97362fe-4fa0-4a3f-85fa-8462a4c07319 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:14.199121 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-d97362fe-4fa0-4a3f-85fa-8462a4c07319 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:14.206633 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-d97362fe-4fa0-4a3f-85fa-8462a4c07319 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:14.207156 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-d97362fe-4fa0-4a3f-85fa-8462a4c07319 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:14.208202 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-d97362fe-4fa0-4a3f-85fa-8462a4c07319 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:14.208698 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-d97362fe-4fa0-4a3f-85fa-8462a4c07319 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:14.360039 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-d97362fe-4fa0-4a3f-85fa-8462a4c07319 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:14.368780 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-d97362fe-4fa0-4a3f-85fa-8462a4c07319 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca" status: 200 len: 1520 microversion: 2.1 time: 0.174492 Oct 29 01:31:14.369342 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 216/426] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:31:14 2021] GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:31:14.744055 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-99b1fec2-75d7-4e28-808b-5eb14f44e6a9 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:31:14.745106 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-99b1fec2-75d7-4e28-808b-5eb14f44e6a9 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:14.753644 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-99b1fec2-75d7-4e28-808b-5eb14f44e6a9 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:14.754157 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-99b1fec2-75d7-4e28-808b-5eb14f44e6a9 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:14.755139 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-99b1fec2-75d7-4e28-808b-5eb14f44e6a9 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:14.755573 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-99b1fec2-75d7-4e28-808b-5eb14f44e6a9 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:14.800576 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-a7bed132-69b5-42e3-9474-52137e82c906 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:31:14.802436 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-a7bed132-69b5-42e3-9474-52137e82c906 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:14.809328 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a7bed132-69b5-42e3-9474-52137e82c906 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:14.809774 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a7bed132-69b5-42e3-9474-52137e82c906 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:14.810591 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a7bed132-69b5-42e3-9474-52137e82c906 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:14.811408 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a7bed132-69b5-42e3-9474-52137e82c906 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:14.859649 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-99b1fec2-75d7-4e28-808b-5eb14f44e6a9 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action" status: 200 len: 38332 microversion: 2.1 time: 0.120142 Oct 29 01:31:14.863098 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 211/427] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:31:14 2021] POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action => generated 38332 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:31:14.874349 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-52f5e2a1-e907-4fd8-b53f-d721d864c93c tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:14.875244 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-52f5e2a1-e907-4fd8-b53f-d721d864c93c tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:14.884868 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-52f5e2a1-e907-4fd8-b53f-d721d864c93c tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:14.885512 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-52f5e2a1-e907-4fd8-b53f-d721d864c93c tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:14.886305 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-52f5e2a1-e907-4fd8-b53f-d721d864c93c tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:14.886742 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-52f5e2a1-e907-4fd8-b53f-d721d864c93c tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:14.919128 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-52f5e2a1-e907-4fd8-b53f-d721d864c93c tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/ips" status: 200 len: 145 microversion: 2.1 time: 0.049829 Oct 29 01:31:14.919714 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 212/428] 10.222.0.87 () {58 vars in 1247 bytes} [Fri Oct 29 01:31:14 2021] GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/ips => generated 145 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:31:14.921546 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-a7bed132-69b5-42e3-9474-52137e82c906 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action" status: 200 len: 38339 microversion: 2.20 time: 0.124647 Oct 29 01:31:14.922605 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 217/429] 10.222.0.87 () {62 vars in 1318 bytes} [Fri Oct 29 01:31:14 2021] POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action => generated 38339 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:31:14.933703 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-c6fe9cb1-73c9-470b-a8cd-8b19ee1ca59c tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:14.934204 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-c6fe9cb1-73c9-470b-a8cd-8b19ee1ca59c tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:14.941343 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-c6fe9cb1-73c9-470b-a8cd-8b19ee1ca59c tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:14.941808 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-c6fe9cb1-73c9-470b-a8cd-8b19ee1ca59c tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:14.942604 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-c6fe9cb1-73c9-470b-a8cd-8b19ee1ca59c tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:14.943032 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-c6fe9cb1-73c9-470b-a8cd-8b19ee1ca59c tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:14.969589 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-c6fe9cb1-73c9-470b-a8cd-8b19ee1ca59c tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/ips" status: 200 len: 152 microversion: 2.20 time: 0.039874 Oct 29 01:31:14.970462 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 213/430] 10.222.0.87 () {60 vars in 1288 bytes} [Fri Oct 29 01:31:14 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/ips => generated 152 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:31:15.392301 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-fa18ff11-73d0-4ed4-b3bc-98f37998babd tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:15.394037 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-fa18ff11-73d0-4ed4-b3bc-98f37998babd tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:15.402858 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-fa18ff11-73d0-4ed4-b3bc-98f37998babd tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:15.403322 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-fa18ff11-73d0-4ed4-b3bc-98f37998babd tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:15.404852 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-fa18ff11-73d0-4ed4-b3bc-98f37998babd tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:15.405827 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-fa18ff11-73d0-4ed4-b3bc-98f37998babd tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:15.546611 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-fa18ff11-73d0-4ed4-b3bc-98f37998babd tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:15.555550 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-fa18ff11-73d0-4ed4-b3bc-98f37998babd tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca" status: 200 len: 1520 microversion: 2.1 time: 0.168547 Oct 29 01:31:15.556232 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 218/431] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:31:15 2021] GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:31:16.571476 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-cf7235f4-7fcc-4cf6-b651-081c198269f7 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:16.577660 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-cf7235f4-7fcc-4cf6-b651-081c198269f7 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:16.579066 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-cf7235f4-7fcc-4cf6-b651-081c198269f7 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:16.579506 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-cf7235f4-7fcc-4cf6-b651-081c198269f7 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:16.580720 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-cf7235f4-7fcc-4cf6-b651-081c198269f7 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:16.581065 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-cf7235f4-7fcc-4cf6-b651-081c198269f7 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:16.744844 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-cf7235f4-7fcc-4cf6-b651-081c198269f7 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:16.756741 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-cf7235f4-7fcc-4cf6-b651-081c198269f7 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca" status: 200 len: 1520 microversion: 2.1 time: 0.188706 Oct 29 01:31:16.757709 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 214/432] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:31:16 2021] GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca => generated 1520 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:31:17.777074 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-dab5d2a7-aaaf-4239-b33b-608e08abb6c3 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:17.778655 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-dab5d2a7-aaaf-4239-b33b-608e08abb6c3 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:17.790458 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-dab5d2a7-aaaf-4239-b33b-608e08abb6c3 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:17.790743 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-dab5d2a7-aaaf-4239-b33b-608e08abb6c3 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:17.791614 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-dab5d2a7-aaaf-4239-b33b-608e08abb6c3 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:17.792105 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-dab5d2a7-aaaf-4239-b33b-608e08abb6c3 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:17.909104 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-1d8b7625-7cf7-4213-b3e0-57389454b33f tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:31:17.909828 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-1d8b7625-7cf7-4213-b3e0-57389454b33f tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:17.922708 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-1d8b7625-7cf7-4213-b3e0-57389454b33f tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:17.924290 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-1d8b7625-7cf7-4213-b3e0-57389454b33f tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:17.925253 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-1d8b7625-7cf7-4213-b3e0-57389454b33f tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:17.925772 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-1d8b7625-7cf7-4213-b3e0-57389454b33f tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:17.989525 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.objects.instance [None req-1d8b7625-7cf7-4213-b3e0-57389454b33f tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lazy-loading 'flavor' on Instance uuid f64f5ebf-8af1-4507-849e-b7d8e33979ae {{(pid=116379) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 01:31:18.006612 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-dab5d2a7-aaaf-4239-b33b-608e08abb6c3 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:18.023591 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-dab5d2a7-aaaf-4239-b33b-608e08abb6c3 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca" status: 200 len: 1520 microversion: 2.1 time: 0.250263 Oct 29 01:31:18.024283 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 219/433] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:31:17 2021] GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca => generated 1520 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:31:18.291617 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-7b9b56d7-4943-4e18-b992-8cc292ff776e tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3e313999-d4ea-4bed-942f-9e61f14fff8c"}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:31:18.293305 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-7b9b56d7-4943-4e18-b992-8cc292ff776e tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:18.300916 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-7b9b56d7-4943-4e18-b992-8cc292ff776e tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:18.301352 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-7b9b56d7-4943-4e18-b992-8cc292ff776e tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:18.302153 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-7b9b56d7-4943-4e18-b992-8cc292ff776e tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:18.303051 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-7b9b56d7-4943-4e18-b992-8cc292ff776e tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:19.427173 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-7b9b56d7-4943-4e18-b992-8cc292ff776e tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.139525 Oct 29 01:31:19.432710 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 220/434] 10.222.0.87 () {60 vars in 1322 bytes} [Fri Oct 29 01:31:18 2021] POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/os-volume_attachments => generated 194 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:31:19.448307 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-9760a25d-bea1-4cc2-8813-7482527965b8 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:19.454337 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-9760a25d-bea1-4cc2-8813-7482527965b8 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:19.469242 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-9760a25d-bea1-4cc2-8813-7482527965b8 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:19.469802 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-9760a25d-bea1-4cc2-8813-7482527965b8 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:19.471294 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-9760a25d-bea1-4cc2-8813-7482527965b8 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:19.472083 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-9760a25d-bea1-4cc2-8813-7482527965b8 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:19.735891 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-9760a25d-bea1-4cc2-8813-7482527965b8 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:19.757340 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-9760a25d-bea1-4cc2-8813-7482527965b8 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca" status: 200 len: 1520 microversion: 2.1 time: 0.327233 Oct 29 01:31:19.758214 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 221/435] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:31:19 2021] GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca => generated 1520 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:31:20.776695 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-d255b849-b965-4405-910e-f2906d40091f tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:20.778090 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-d255b849-b965-4405-910e-f2906d40091f tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:20.787365 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-d255b849-b965-4405-910e-f2906d40091f tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:20.792848 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-d255b849-b965-4405-910e-f2906d40091f tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:20.793936 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-d255b849-b965-4405-910e-f2906d40091f tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:20.795128 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-d255b849-b965-4405-910e-f2906d40091f tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:21.064851 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-d255b849-b965-4405-910e-f2906d40091f tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:21.082943 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-d255b849-b965-4405-910e-f2906d40091f tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca" status: 200 len: 1520 microversion: 2.1 time: 0.311484 Oct 29 01:31:21.096247 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 222/436] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:31:20 2021] GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca => generated 1520 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:31:22.102628 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-469065bd-938e-4dcc-8302-86168c5965b5 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:22.104480 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-469065bd-938e-4dcc-8302-86168c5965b5 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:22.114887 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-469065bd-938e-4dcc-8302-86168c5965b5 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:22.115749 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-469065bd-938e-4dcc-8302-86168c5965b5 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:22.117207 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-469065bd-938e-4dcc-8302-86168c5965b5 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:22.118269 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-469065bd-938e-4dcc-8302-86168c5965b5 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:22.332035 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-469065bd-938e-4dcc-8302-86168c5965b5 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:22.343511 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-469065bd-938e-4dcc-8302-86168c5965b5 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca" status: 200 len: 1520 microversion: 2.1 time: 0.245598 Oct 29 01:31:22.344144 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 223/437] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:31:22 2021] GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca => generated 1520 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:31:23.362393 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-64f44490-895c-4e14-9238-34d2441d3024 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:23.364757 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-64f44490-895c-4e14-9238-34d2441d3024 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:23.372049 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-64f44490-895c-4e14-9238-34d2441d3024 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:23.372972 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-64f44490-895c-4e14-9238-34d2441d3024 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:23.378408 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-64f44490-895c-4e14-9238-34d2441d3024 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:23.378408 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-64f44490-895c-4e14-9238-34d2441d3024 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:23.543274 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-64f44490-895c-4e14-9238-34d2441d3024 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:23.555423 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-64f44490-895c-4e14-9238-34d2441d3024 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca" status: 200 len: 1520 microversion: 2.1 time: 0.197503 Oct 29 01:31:23.556575 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 224/438] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:31:23 2021] GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca => generated 1520 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:31:24.573344 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-3e2b2b8c-d989-451a-b608-79cfe85ae954 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:24.574178 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-3e2b2b8c-d989-451a-b608-79cfe85ae954 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:24.580651 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-3e2b2b8c-d989-451a-b608-79cfe85ae954 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:24.581308 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-3e2b2b8c-d989-451a-b608-79cfe85ae954 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:24.582299 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-3e2b2b8c-d989-451a-b608-79cfe85ae954 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:24.582781 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-3e2b2b8c-d989-451a-b608-79cfe85ae954 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:24.739239 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-3e2b2b8c-d989-451a-b608-79cfe85ae954 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:24.747093 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-3e2b2b8c-d989-451a-b608-79cfe85ae954 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca" status: 200 len: 1520 microversion: 2.1 time: 0.177471 Oct 29 01:31:24.747665 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 225/439] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:31:24 2021] GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:31:25.763561 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-c437f4b0-d50a-477c-be74-44789d50e653 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:25.764290 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-c437f4b0-d50a-477c-be74-44789d50e653 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:25.771016 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c437f4b0-d50a-477c-be74-44789d50e653 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:25.771472 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c437f4b0-d50a-477c-be74-44789d50e653 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:25.772359 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c437f4b0-d50a-477c-be74-44789d50e653 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:25.772870 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c437f4b0-d50a-477c-be74-44789d50e653 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:25.937871 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-c437f4b0-d50a-477c-be74-44789d50e653 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:25.946193 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-c437f4b0-d50a-477c-be74-44789d50e653 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca" status: 200 len: 1520 microversion: 2.1 time: 0.186307 Oct 29 01:31:25.947113 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 226/440] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:31:25 2021] GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca => generated 1520 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:31:26.578672 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-1d8b7625-7cf7-4213-b3e0-57389454b33f tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action" status: 202 len: 0 microversion: 2.20 time: 8.673419 Oct 29 01:31:26.579463 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 215/441] 10.222.0.87 () {62 vars in 1318 bytes} [Fri Oct 29 01:31:17 2021] POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action => generated 0 bytes in 8675 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:31:26.589851 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-90942c84-309e-4424-8da5-8ef6fe946ef5 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:26.590840 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-90942c84-309e-4424-8da5-8ef6fe946ef5 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:26.601073 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-90942c84-309e-4424-8da5-8ef6fe946ef5 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:26.603031 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-90942c84-309e-4424-8da5-8ef6fe946ef5 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:26.603031 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-90942c84-309e-4424-8da5-8ef6fe946ef5 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:26.603226 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-90942c84-309e-4424-8da5-8ef6fe946ef5 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:26.755811 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-90942c84-309e-4424-8da5-8ef6fe946ef5 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:26.763714 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-90942c84-309e-4424-8da5-8ef6fe946ef5 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:26.766186 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-90942c84-309e-4424-8da5-8ef6fe946ef5 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:26.767339 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-90942c84-309e-4424-8da5-8ef6fe946ef5 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1723 microversion: 2.20 time: 0.182647 Oct 29 01:31:26.767918 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 227/442] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:31:26 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:31:26.968900 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-d32ed046-7bb8-4eb2-8f4d-51ab48679795 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:26.970052 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-d32ed046-7bb8-4eb2-8f4d-51ab48679795 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:26.988920 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d32ed046-7bb8-4eb2-8f4d-51ab48679795 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:26.991427 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d32ed046-7bb8-4eb2-8f4d-51ab48679795 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:26.996094 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d32ed046-7bb8-4eb2-8f4d-51ab48679795 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:26.997247 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d32ed046-7bb8-4eb2-8f4d-51ab48679795 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:27.147001 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-d32ed046-7bb8-4eb2-8f4d-51ab48679795 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:27.154416 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-d32ed046-7bb8-4eb2-8f4d-51ab48679795 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca" status: 200 len: 1520 microversion: 2.1 time: 0.193274 Oct 29 01:31:27.155499 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 216/443] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:31:26 2021] GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca => generated 1520 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:31:27.785446 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-1ff43c7f-aa6e-4f12-a3a5-485c102b468e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:27.789114 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-1ff43c7f-aa6e-4f12-a3a5-485c102b468e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:27.792691 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-1ff43c7f-aa6e-4f12-a3a5-485c102b468e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:27.793137 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-1ff43c7f-aa6e-4f12-a3a5-485c102b468e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:27.793912 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-1ff43c7f-aa6e-4f12-a3a5-485c102b468e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:27.794368 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-1ff43c7f-aa6e-4f12-a3a5-485c102b468e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:27.932917 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-1ff43c7f-aa6e-4f12-a3a5-485c102b468e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:27.941705 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-1ff43c7f-aa6e-4f12-a3a5-485c102b468e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:27.943455 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-1ff43c7f-aa6e-4f12-a3a5-485c102b468e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:27.945072 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-1ff43c7f-aa6e-4f12-a3a5-485c102b468e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1723 microversion: 2.20 time: 0.163886 Oct 29 01:31:27.945860 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 228/444] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:31:27 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:31:28.141652 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-a810d604-60a6-4afc-8efa-3a2347d04e63 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:31:28.149604 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-a810d604-60a6-4afc-8efa-3a2347d04e63 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:28.153253 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-a810d604-60a6-4afc-8efa-3a2347d04e63 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:28.172058 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-1e96606b-5ded-4915-a3ea-04a7f7f1c1b1 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:28.176242 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-1e96606b-5ded-4915-a3ea-04a7f7f1c1b1 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:28.179133 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-1e96606b-5ded-4915-a3ea-04a7f7f1c1b1 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:28.179574 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-1e96606b-5ded-4915-a3ea-04a7f7f1c1b1 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:28.180356 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-1e96606b-5ded-4915-a3ea-04a7f7f1c1b1 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:28.180782 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-1e96606b-5ded-4915-a3ea-04a7f7f1c1b1 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:28.214640 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-a810d604-60a6-4afc-8efa-3a2347d04e63 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Going to try to stop instance {{(pid=116379) force_stop /opt/stack/nova/nova/compute/api.py:2652}} Oct 29 01:31:28.340884 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-1e96606b-5ded-4915-a3ea-04a7f7f1c1b1 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:28.348744 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-1e96606b-5ded-4915-a3ea-04a7f7f1c1b1 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca" status: 200 len: 1520 microversion: 2.1 time: 0.180201 Oct 29 01:31:28.349525 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 229/445] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:31:28 2021] GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca => generated 1520 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:31:28.454622 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-a810d604-60a6-4afc-8efa-3a2347d04e63 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action" status: 202 len: 0 microversion: 2.1 time: 0.315209 Oct 29 01:31:28.455678 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 217/446] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:31:28 2021] POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:31:28.464482 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-44c56529-c9b3-4b67-a50e-9fdff508a362 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:28.465392 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-44c56529-c9b3-4b67-a50e-9fdff508a362 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:28.473655 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-44c56529-c9b3-4b67-a50e-9fdff508a362 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:28.474102 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-44c56529-c9b3-4b67-a50e-9fdff508a362 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:28.475716 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-44c56529-c9b3-4b67-a50e-9fdff508a362 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:28.476429 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-44c56529-c9b3-4b67-a50e-9fdff508a362 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:28.610380 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-44c56529-c9b3-4b67-a50e-9fdff508a362 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045dda1ff9b44334954c08e63fcd20c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51a2093a0874d52a08f6e25489ba181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:28.618434 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-44c56529-c9b3-4b67-a50e-9fdff508a362 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92" status: 200 len: 1724 microversion: 2.1 time: 0.157957 Oct 29 01:31:28.619357 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 230/447] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:31:28 2021] GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:31:28.965283 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-f050211b-43ca-4f19-aea9-d2dae564c015 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:28.966364 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-f050211b-43ca-4f19-aea9-d2dae564c015 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:28.974115 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-f050211b-43ca-4f19-aea9-d2dae564c015 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:28.975007 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-f050211b-43ca-4f19-aea9-d2dae564c015 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:28.975890 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-f050211b-43ca-4f19-aea9-d2dae564c015 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:28.976645 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-f050211b-43ca-4f19-aea9-d2dae564c015 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:29.151034 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-f050211b-43ca-4f19-aea9-d2dae564c015 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:29.167204 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-f050211b-43ca-4f19-aea9-d2dae564c015 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:29.168746 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-f050211b-43ca-4f19-aea9-d2dae564c015 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:29.172012 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-f050211b-43ca-4f19-aea9-d2dae564c015 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1723 microversion: 2.20 time: 0.209310 Oct 29 01:31:29.184531 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 218/448] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:31:28 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1723 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:31:29.368754 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-b6b37b4e-5e8e-468f-bcc1-588a66188b2c tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:29.369477 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-b6b37b4e-5e8e-468f-bcc1-588a66188b2c tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:29.376573 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-b6b37b4e-5e8e-468f-bcc1-588a66188b2c tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:29.377068 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-b6b37b4e-5e8e-468f-bcc1-588a66188b2c tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:29.378234 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-b6b37b4e-5e8e-468f-bcc1-588a66188b2c tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:29.379524 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-b6b37b4e-5e8e-468f-bcc1-588a66188b2c tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:29.526738 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-b6b37b4e-5e8e-468f-bcc1-588a66188b2c tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:29.534967 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-b6b37b4e-5e8e-468f-bcc1-588a66188b2c tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca" status: 200 len: 1520 microversion: 2.1 time: 0.170934 Oct 29 01:31:29.535691 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 231/449] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:31:29 2021] GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:31:29.636412 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-99b6c08b-ce00-4b1f-8824-0461432c6c67 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:29.637150 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-99b6c08b-ce00-4b1f-8824-0461432c6c67 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:29.644715 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-99b6c08b-ce00-4b1f-8824-0461432c6c67 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:29.645573 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-99b6c08b-ce00-4b1f-8824-0461432c6c67 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:29.646457 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-99b6c08b-ce00-4b1f-8824-0461432c6c67 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:29.646958 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-99b6c08b-ce00-4b1f-8824-0461432c6c67 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:29.797518 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-99b6c08b-ce00-4b1f-8824-0461432c6c67 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045dda1ff9b44334954c08e63fcd20c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51a2093a0874d52a08f6e25489ba181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:29.807615 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-99b6c08b-ce00-4b1f-8824-0461432c6c67 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92" status: 200 len: 1724 microversion: 2.1 time: 0.175082 Oct 29 01:31:29.808932 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 219/450] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:31:29 2021] GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92 => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:31:30.202465 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-4ffd6ed4-87a6-40a8-b53a-3bc3ef686017 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:30.203091 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-4ffd6ed4-87a6-40a8-b53a-3bc3ef686017 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:30.210939 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4ffd6ed4-87a6-40a8-b53a-3bc3ef686017 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:30.211373 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4ffd6ed4-87a6-40a8-b53a-3bc3ef686017 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:30.212319 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4ffd6ed4-87a6-40a8-b53a-3bc3ef686017 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:30.212755 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4ffd6ed4-87a6-40a8-b53a-3bc3ef686017 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:30.366906 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-4ffd6ed4-87a6-40a8-b53a-3bc3ef686017 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:30.375455 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-4ffd6ed4-87a6-40a8-b53a-3bc3ef686017 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:30.377298 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-4ffd6ed4-87a6-40a8-b53a-3bc3ef686017 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:30.378613 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-4ffd6ed4-87a6-40a8-b53a-3bc3ef686017 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1723 microversion: 2.20 time: 0.179947 Oct 29 01:31:30.379023 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 232/451] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:31:30 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:31:30.553057 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-5f982888-452d-4a0a-b3e3-17014c23df39 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:30.553714 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-5f982888-452d-4a0a-b3e3-17014c23df39 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:30.561031 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-5f982888-452d-4a0a-b3e3-17014c23df39 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:30.561475 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-5f982888-452d-4a0a-b3e3-17014c23df39 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:30.562258 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-5f982888-452d-4a0a-b3e3-17014c23df39 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:30.562689 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-5f982888-452d-4a0a-b3e3-17014c23df39 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:30.717611 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-5f982888-452d-4a0a-b3e3-17014c23df39 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:30.727306 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-5f982888-452d-4a0a-b3e3-17014c23df39 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca" status: 200 len: 1500 microversion: 2.1 time: 0.177903 Oct 29 01:31:30.728077 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 220/452] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:31:30 2021] GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca => generated 1500 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:31:30.745037 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-fde7f4a4-e412-4053-988c-1674b4c7521c tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "31771f68-fc34-4a40-b44e-f41b05347f58"}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:31:30.747124 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-fde7f4a4-e412-4053-988c-1674b4c7521c tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:30.752422 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-fde7f4a4-e412-4053-988c-1674b4c7521c tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:30.753975 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-fde7f4a4-e412-4053-988c-1674b4c7521c tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:30.755472 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-fde7f4a4-e412-4053-988c-1674b4c7521c tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:30.756702 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-fde7f4a4-e412-4053-988c-1674b4c7521c tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:30.785495 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.wsgi [None req-fde7f4a4-e412-4053-988c-1674b4c7521c tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] HTTP exception thrown: Cannot 'attach_volume' instance 09875e40-e63d-4175-9361-fd9439c0c7ca while it is in vm_state rescued Oct 29 01:31:30.786166 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-fde7f4a4-e412-4053-988c-1674b4c7521c tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Returning 409 to user: Cannot 'attach_volume' instance 09875e40-e63d-4175-9361-fd9439c0c7ca while it is in vm_state rescued {{(pid=116378) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:31:30.787030 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-fde7f4a4-e412-4053-988c-1674b4c7521c tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "POST /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.046107 Oct 29 01:31:30.787610 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 233/453] 10.222.0.87 () {60 vars in 1322 bytes} [Fri Oct 29 01:31:30 2021] POST /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca/os-volume_attachments => generated 152 bytes in 47 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 29 01:31:30.796389 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-887bacc4-f8b8-4358-b72b-af993a4fa544 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:31:30.796933 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-887bacc4-f8b8-4358-b72b-af993a4fa544 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:30.804874 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-887bacc4-f8b8-4358-b72b-af993a4fa544 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:30.805348 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-887bacc4-f8b8-4358-b72b-af993a4fa544 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:30.806139 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-887bacc4-f8b8-4358-b72b-af993a4fa544 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:30.806801 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-887bacc4-f8b8-4358-b72b-af993a4fa544 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:30.843135 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-13971d13-ee4d-4c10-b997-1d4ae56fea57 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:30.843880 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-13971d13-ee4d-4c10-b997-1d4ae56fea57 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:30.859446 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-13971d13-ee4d-4c10-b997-1d4ae56fea57 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:30.860622 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-13971d13-ee4d-4c10-b997-1d4ae56fea57 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:30.864962 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-13971d13-ee4d-4c10-b997-1d4ae56fea57 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:30.865982 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-13971d13-ee4d-4c10-b997-1d4ae56fea57 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:31.011716 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-13971d13-ee4d-4c10-b997-1d4ae56fea57 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045dda1ff9b44334954c08e63fcd20c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51a2093a0874d52a08f6e25489ba181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:31.020878 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-13971d13-ee4d-4c10-b997-1d4ae56fea57 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92" status: 200 len: 1724 microversion: 2.1 time: 0.183714 Oct 29 01:31:31.021442 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 234/454] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:31:30 2021] GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92 => generated 1724 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:31:31.145151 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-887bacc4-f8b8-4358-b72b-af993a4fa544 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "POST /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca/action" status: 202 len: 0 microversion: 2.1 time: 0.352237 Oct 29 01:31:31.149608 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 221/455] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:31:30 2021] POST /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca/action => generated 0 bytes in 355 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:31:31.154692 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-4a5f451b-21d0-4553-90e8-7ee557ef3fe3 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:31.155473 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-4a5f451b-21d0-4553-90e8-7ee557ef3fe3 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:31.178737 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4a5f451b-21d0-4553-90e8-7ee557ef3fe3 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:31.180021 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4a5f451b-21d0-4553-90e8-7ee557ef3fe3 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:31.180837 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4a5f451b-21d0-4553-90e8-7ee557ef3fe3 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:31.181273 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4a5f451b-21d0-4553-90e8-7ee557ef3fe3 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:31.399276 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-505a8716-245f-43ea-a4fc-85ad517a030b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:31.400799 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-505a8716-245f-43ea-a4fc-85ad517a030b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:31.412700 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-505a8716-245f-43ea-a4fc-85ad517a030b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:31.414444 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-505a8716-245f-43ea-a4fc-85ad517a030b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:31.415511 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-505a8716-245f-43ea-a4fc-85ad517a030b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:31.416185 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-505a8716-245f-43ea-a4fc-85ad517a030b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:31.728938 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-4a5f451b-21d0-4553-90e8-7ee557ef3fe3 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:31.738147 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-4a5f451b-21d0-4553-90e8-7ee557ef3fe3 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca" status: 200 len: 1508 microversion: 2.1 time: 0.586886 Oct 29 01:31:31.739353 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 235/456] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:31:31 2021] GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca => generated 1508 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:31:31.801697 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-505a8716-245f-43ea-a4fc-85ad517a030b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:31.809664 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-505a8716-245f-43ea-a4fc-85ad517a030b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:31.811466 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-505a8716-245f-43ea-a4fc-85ad517a030b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:31.823113 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-505a8716-245f-43ea-a4fc-85ad517a030b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1723 microversion: 2.20 time: 0.417789 Oct 29 01:31:31.823505 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 222/457] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:31:31 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1723 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:31:32.038952 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-ebe63bce-0194-4c5a-9210-8076c084391f tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:32.039787 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-ebe63bce-0194-4c5a-9210-8076c084391f tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:32.046198 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ebe63bce-0194-4c5a-9210-8076c084391f tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:32.047123 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ebe63bce-0194-4c5a-9210-8076c084391f tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:32.048208 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ebe63bce-0194-4c5a-9210-8076c084391f tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:32.048870 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ebe63bce-0194-4c5a-9210-8076c084391f tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:32.267820 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-ebe63bce-0194-4c5a-9210-8076c084391f tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045dda1ff9b44334954c08e63fcd20c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51a2093a0874d52a08f6e25489ba181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:32.275920 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-ebe63bce-0194-4c5a-9210-8076c084391f tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92" status: 200 len: 1724 microversion: 2.1 time: 0.241520 Oct 29 01:31:32.276858 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 236/458] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:31:32 2021] GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92 => generated 1724 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:31:32.757189 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-d0bb1678-ef26-41cb-8bc7-eaa7945d9b08 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:32.757843 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-d0bb1678-ef26-41cb-8bc7-eaa7945d9b08 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:32.764268 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d0bb1678-ef26-41cb-8bc7-eaa7945d9b08 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:32.765138 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d0bb1678-ef26-41cb-8bc7-eaa7945d9b08 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:32.766092 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d0bb1678-ef26-41cb-8bc7-eaa7945d9b08 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:32.766536 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d0bb1678-ef26-41cb-8bc7-eaa7945d9b08 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:32.835266 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-1c655418-5427-46b7-bd2f-b09fa0a5ff8c tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:32.836620 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-1c655418-5427-46b7-bd2f-b09fa0a5ff8c tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:32.844253 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-1c655418-5427-46b7-bd2f-b09fa0a5ff8c tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:32.844820 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-1c655418-5427-46b7-bd2f-b09fa0a5ff8c tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:32.845663 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-1c655418-5427-46b7-bd2f-b09fa0a5ff8c tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:32.847428 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-1c655418-5427-46b7-bd2f-b09fa0a5ff8c tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:32.951638 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-d0bb1678-ef26-41cb-8bc7-eaa7945d9b08 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:32.964505 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-d0bb1678-ef26-41cb-8bc7-eaa7945d9b08 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca" status: 200 len: 1508 microversion: 2.1 time: 0.211003 Oct 29 01:31:32.965422 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 223/459] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:31:32 2021] GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca => generated 1508 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:31:33.008005 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-1c655418-5427-46b7-bd2f-b09fa0a5ff8c tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:33.016906 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-1c655418-5427-46b7-bd2f-b09fa0a5ff8c tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:33.019245 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-1c655418-5427-46b7-bd2f-b09fa0a5ff8c tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:33.020565 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-1c655418-5427-46b7-bd2f-b09fa0a5ff8c tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1723 microversion: 2.20 time: 0.193429 Oct 29 01:31:33.021183 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 237/460] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:31:32 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1723 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:31:33.292964 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-8ffe6f01-21dc-4790-a76c-76066487912c tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:33.293926 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-8ffe6f01-21dc-4790-a76c-76066487912c tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:33.300170 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-8ffe6f01-21dc-4790-a76c-76066487912c tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:33.300801 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-8ffe6f01-21dc-4790-a76c-76066487912c tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:33.301751 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-8ffe6f01-21dc-4790-a76c-76066487912c tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:33.302174 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-8ffe6f01-21dc-4790-a76c-76066487912c tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:33.444172 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-8ffe6f01-21dc-4790-a76c-76066487912c tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045dda1ff9b44334954c08e63fcd20c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51a2093a0874d52a08f6e25489ba181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:33.452644 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-8ffe6f01-21dc-4790-a76c-76066487912c tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92" status: 200 len: 1724 microversion: 2.1 time: 0.163327 Oct 29 01:31:33.463250 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 224/461] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:31:33 2021] GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:31:33.594599 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-84090d1f-fada-4839-a930-590d5e26c66c tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "95cb5978-8c41-4087-8b63-101de93c9e49", "device": "/dev/sdb"}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:31:33.596999 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-84090d1f-fada-4839-a930-590d5e26c66c tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] [instance: 93f60f90-a29b-4ae7-b9dc-ec821e4c7e10] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:33.603865 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-84090d1f-fada-4839-a930-590d5e26c66c tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:33.604284 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-84090d1f-fada-4839-a930-590d5e26c66c tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:33.605047 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-84090d1f-fada-4839-a930-590d5e26c66c tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:33.605480 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-84090d1f-fada-4839-a930-590d5e26c66c tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:33.981494 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-56232913-1bcc-4f0f-afae-68d6010074d4 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:33.983007 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-56232913-1bcc-4f0f-afae-68d6010074d4 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:33.990239 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-56232913-1bcc-4f0f-afae-68d6010074d4 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:33.990964 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-56232913-1bcc-4f0f-afae-68d6010074d4 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:33.991870 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-56232913-1bcc-4f0f-afae-68d6010074d4 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:33.992372 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-56232913-1bcc-4f0f-afae-68d6010074d4 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:34.129096 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-56232913-1bcc-4f0f-afae-68d6010074d4 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:34.136999 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-56232913-1bcc-4f0f-afae-68d6010074d4 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca" status: 200 len: 1508 microversion: 2.1 time: 0.159005 Oct 29 01:31:34.137499 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 225/462] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:31:33 2021] GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca => generated 1508 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:31:34.151543 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-5cb90b37-7a98-4615-85f1-ccee47e1657c tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:34.152438 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-5cb90b37-7a98-4615-85f1-ccee47e1657c tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:34.158422 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-5cb90b37-7a98-4615-85f1-ccee47e1657c tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:34.160037 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-5cb90b37-7a98-4615-85f1-ccee47e1657c tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:34.170103 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-5cb90b37-7a98-4615-85f1-ccee47e1657c tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:34.170103 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-5cb90b37-7a98-4615-85f1-ccee47e1657c tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:34.331962 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-5cb90b37-7a98-4615-85f1-ccee47e1657c tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:34.344176 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-5cb90b37-7a98-4615-85f1-ccee47e1657c tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:34.346295 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-5cb90b37-7a98-4615-85f1-ccee47e1657c tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:34.347675 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-5cb90b37-7a98-4615-85f1-ccee47e1657c tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1723 microversion: 2.20 time: 0.199811 Oct 29 01:31:34.348654 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 226/463] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:31:34 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1723 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:31:34.470172 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-83e255cd-5b34-400b-b2ee-34cfd349efab tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:34.470772 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-83e255cd-5b34-400b-b2ee-34cfd349efab tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:34.478033 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-83e255cd-5b34-400b-b2ee-34cfd349efab tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:34.478477 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-83e255cd-5b34-400b-b2ee-34cfd349efab tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:34.479285 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-83e255cd-5b34-400b-b2ee-34cfd349efab tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:34.479711 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-83e255cd-5b34-400b-b2ee-34cfd349efab tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:34.515220 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-84090d1f-fada-4839-a930-590d5e26c66c tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] 10.222.0.87 "POST /compute/v2.1/servers/93f60f90-a29b-4ae7-b9dc-ec821e4c7e10/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.924128 Oct 29 01:31:34.515862 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 238/464] 10.222.0.87 () {60 vars in 1322 bytes} [Fri Oct 29 01:31:33 2021] POST /compute/v2.1/servers/93f60f90-a29b-4ae7-b9dc-ec821e4c7e10/os-volume_attachments => generated 194 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:31:34.679130 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-83e255cd-5b34-400b-b2ee-34cfd349efab tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045dda1ff9b44334954c08e63fcd20c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51a2093a0874d52a08f6e25489ba181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:34.691182 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-83e255cd-5b34-400b-b2ee-34cfd349efab tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92" status: 200 len: 1724 microversion: 2.1 time: 0.224638 Oct 29 01:31:34.702088 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 227/465] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:31:34 2021] GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92 => generated 1724 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:31:35.156152 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-e510e467-236f-4b7c-852b-c2e6435bc9cf tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:35.156789 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-e510e467-236f-4b7c-852b-c2e6435bc9cf tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:35.164001 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-e510e467-236f-4b7c-852b-c2e6435bc9cf tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:35.164453 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-e510e467-236f-4b7c-852b-c2e6435bc9cf tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:35.165265 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-e510e467-236f-4b7c-852b-c2e6435bc9cf tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:35.165686 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-e510e467-236f-4b7c-852b-c2e6435bc9cf tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:35.313324 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-e510e467-236f-4b7c-852b-c2e6435bc9cf tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:35.323102 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-e510e467-236f-4b7c-852b-c2e6435bc9cf tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca" status: 200 len: 1514 microversion: 2.1 time: 0.172009 Oct 29 01:31:35.323844 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 239/466] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:31:35 2021] GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca => generated 1514 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:31:35.367265 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-a552861a-f431-407f-96f1-4b839e000f7d tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:35.369401 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-a552861a-f431-407f-96f1-4b839e000f7d tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:35.380261 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-a552861a-f431-407f-96f1-4b839e000f7d tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:35.380837 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-a552861a-f431-407f-96f1-4b839e000f7d tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:35.381691 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-a552861a-f431-407f-96f1-4b839e000f7d tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:35.382183 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-a552861a-f431-407f-96f1-4b839e000f7d tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:35.555852 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-a552861a-f431-407f-96f1-4b839e000f7d tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:35.563855 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-a552861a-f431-407f-96f1-4b839e000f7d tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:35.566065 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-a552861a-f431-407f-96f1-4b839e000f7d tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:35.567237 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-a552861a-f431-407f-96f1-4b839e000f7d tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1723 microversion: 2.20 time: 0.205124 Oct 29 01:31:35.567838 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 228/467] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:31:35 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1723 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:31:35.709892 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-d413afce-8ab4-4a74-acb3-6a30745e4838 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:35.710562 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-d413afce-8ab4-4a74-acb3-6a30745e4838 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:35.716554 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-d413afce-8ab4-4a74-acb3-6a30745e4838 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:35.716994 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-d413afce-8ab4-4a74-acb3-6a30745e4838 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:35.717778 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-d413afce-8ab4-4a74-acb3-6a30745e4838 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:35.718210 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-d413afce-8ab4-4a74-acb3-6a30745e4838 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:35.847459 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-d413afce-8ab4-4a74-acb3-6a30745e4838 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045dda1ff9b44334954c08e63fcd20c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51a2093a0874d52a08f6e25489ba181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:35.855331 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-d413afce-8ab4-4a74-acb3-6a30745e4838 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92" status: 200 len: 1724 microversion: 2.1 time: 0.149677 Oct 29 01:31:35.855928 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 240/468] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:31:35 2021] GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:31:36.585687 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-79eb5c3d-5f0e-4065-979d-a1530dd853c0 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:36.586210 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-79eb5c3d-5f0e-4065-979d-a1530dd853c0 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:36.592419 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-79eb5c3d-5f0e-4065-979d-a1530dd853c0 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:36.592872 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-79eb5c3d-5f0e-4065-979d-a1530dd853c0 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:36.593676 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-79eb5c3d-5f0e-4065-979d-a1530dd853c0 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:36.594080 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-79eb5c3d-5f0e-4065-979d-a1530dd853c0 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:36.717401 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-79eb5c3d-5f0e-4065-979d-a1530dd853c0 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:36.725691 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-79eb5c3d-5f0e-4065-979d-a1530dd853c0 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:36.727163 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-79eb5c3d-5f0e-4065-979d-a1530dd853c0 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:36.728326 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-79eb5c3d-5f0e-4065-979d-a1530dd853c0 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1723 microversion: 2.20 time: 0.146394 Oct 29 01:31:36.734641 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 229/469] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:31:36 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:31:36.875894 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-69bfa4f5-8895-4dec-ba66-e62ff8dfb2ea tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:36.876934 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-69bfa4f5-8895-4dec-ba66-e62ff8dfb2ea tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:36.884083 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-69bfa4f5-8895-4dec-ba66-e62ff8dfb2ea tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:36.884526 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-69bfa4f5-8895-4dec-ba66-e62ff8dfb2ea tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:36.885284 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-69bfa4f5-8895-4dec-ba66-e62ff8dfb2ea tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:36.885750 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-69bfa4f5-8895-4dec-ba66-e62ff8dfb2ea tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:37.014839 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-69bfa4f5-8895-4dec-ba66-e62ff8dfb2ea tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045dda1ff9b44334954c08e63fcd20c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51a2093a0874d52a08f6e25489ba181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:37.025993 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-69bfa4f5-8895-4dec-ba66-e62ff8dfb2ea tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92" status: 200 len: 1724 microversion: 2.1 time: 0.156321 Oct 29 01:31:37.026649 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 241/470] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:31:36 2021] GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:31:37.066955 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-00b5184b-290a-4c00-92c6-6c101d4208f4 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:37.067554 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-00b5184b-290a-4c00-92c6-6c101d4208f4 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:37.073343 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-00b5184b-290a-4c00-92c6-6c101d4208f4 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:37.073788 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-00b5184b-290a-4c00-92c6-6c101d4208f4 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:37.074549 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-00b5184b-290a-4c00-92c6-6c101d4208f4 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:37.083172 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-00b5184b-290a-4c00-92c6-6c101d4208f4 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:37.201443 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-00b5184b-290a-4c00-92c6-6c101d4208f4 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:37.209823 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-00b5184b-290a-4c00-92c6-6c101d4208f4 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca" status: 200 len: 1514 microversion: 2.1 time: 0.147145 Oct 29 01:31:37.210409 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 230/471] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:31:37 2021] GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca => generated 1514 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:31:37.226722 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-a7939bce-d7aa-4c40-96a5-15b9f16a51a9 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fb918fd7-72dd-4250-8fc5-fa49f55fd7bd"}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:31:37.227878 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-a7939bce-d7aa-4c40-96a5-15b9f16a51a9 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:37.234080 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a7939bce-d7aa-4c40-96a5-15b9f16a51a9 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:37.234455 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a7939bce-d7aa-4c40-96a5-15b9f16a51a9 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:37.235230 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a7939bce-d7aa-4c40-96a5-15b9f16a51a9 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:37.235662 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a7939bce-d7aa-4c40-96a5-15b9f16a51a9 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:37.747046 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-ff29f045-e363-4f7b-a4ba-599c7e3d8eac tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:37.749516 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-ff29f045-e363-4f7b-a4ba-599c7e3d8eac tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:37.758833 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-ff29f045-e363-4f7b-a4ba-599c7e3d8eac tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:37.759801 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-ff29f045-e363-4f7b-a4ba-599c7e3d8eac tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:37.760741 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-ff29f045-e363-4f7b-a4ba-599c7e3d8eac tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:37.761311 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-ff29f045-e363-4f7b-a4ba-599c7e3d8eac tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:37.913505 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-ff29f045-e363-4f7b-a4ba-599c7e3d8eac tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:37.921702 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-ff29f045-e363-4f7b-a4ba-599c7e3d8eac tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:37.923104 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-ff29f045-e363-4f7b-a4ba-599c7e3d8eac tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:37.924303 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-ff29f045-e363-4f7b-a4ba-599c7e3d8eac tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1723 microversion: 2.20 time: 0.181584 Oct 29 01:31:37.925443 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 231/472] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:31:37 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:31:38.042317 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-1e8761c2-45b1-4987-b3a7-463eb8eb3af6 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:38.042954 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-1e8761c2-45b1-4987-b3a7-463eb8eb3af6 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:38.048864 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-1e8761c2-45b1-4987-b3a7-463eb8eb3af6 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:38.049338 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-1e8761c2-45b1-4987-b3a7-463eb8eb3af6 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:38.050734 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-1e8761c2-45b1-4987-b3a7-463eb8eb3af6 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:38.051139 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-1e8761c2-45b1-4987-b3a7-463eb8eb3af6 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:38.179790 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-1e8761c2-45b1-4987-b3a7-463eb8eb3af6 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045dda1ff9b44334954c08e63fcd20c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51a2093a0874d52a08f6e25489ba181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:38.191689 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-1e8761c2-45b1-4987-b3a7-463eb8eb3af6 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92" status: 200 len: 1724 microversion: 2.1 time: 0.152934 Oct 29 01:31:38.192596 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 232/473] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:31:38 2021] GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:31:38.258472 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-a7939bce-d7aa-4c40-96a5-15b9f16a51a9 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "POST /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.036313 Oct 29 01:31:38.259082 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 242/474] 10.222.0.87 () {60 vars in 1322 bytes} [Fri Oct 29 01:31:37 2021] POST /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca/os-volume_attachments => generated 194 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:31:38.945116 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-cfbab0d3-5cab-4097-b7aa-56f47077caa7 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:38.945116 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-cfbab0d3-5cab-4097-b7aa-56f47077caa7 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:38.949976 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-cfbab0d3-5cab-4097-b7aa-56f47077caa7 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:38.950682 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-cfbab0d3-5cab-4097-b7aa-56f47077caa7 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:38.951447 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-cfbab0d3-5cab-4097-b7aa-56f47077caa7 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:38.951915 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-cfbab0d3-5cab-4097-b7aa-56f47077caa7 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:39.081667 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-cfbab0d3-5cab-4097-b7aa-56f47077caa7 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:39.095609 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-cfbab0d3-5cab-4097-b7aa-56f47077caa7 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:39.097804 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-cfbab0d3-5cab-4097-b7aa-56f47077caa7 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:39.098941 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-cfbab0d3-5cab-4097-b7aa-56f47077caa7 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1723 microversion: 2.20 time: 0.160447 Oct 29 01:31:39.099705 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 233/475] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:31:38 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:31:39.210485 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-a0adb3bd-928d-42ad-9dcb-754cc9f99ebc tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:39.211204 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-a0adb3bd-928d-42ad-9dcb-754cc9f99ebc tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:39.217574 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a0adb3bd-928d-42ad-9dcb-754cc9f99ebc tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:39.217910 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a0adb3bd-928d-42ad-9dcb-754cc9f99ebc tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:39.218714 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a0adb3bd-928d-42ad-9dcb-754cc9f99ebc tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:39.219293 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a0adb3bd-928d-42ad-9dcb-754cc9f99ebc tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:39.357371 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-a0adb3bd-928d-42ad-9dcb-754cc9f99ebc tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045dda1ff9b44334954c08e63fcd20c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51a2093a0874d52a08f6e25489ba181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:39.365869 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-a0adb3bd-928d-42ad-9dcb-754cc9f99ebc tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92" status: 200 len: 1724 microversion: 2.1 time: 0.159828 Oct 29 01:31:39.366459 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 243/476] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:31:39 2021] GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:31:40.118933 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-39b81931-6408-49b6-b1fa-98acbeab13a2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:40.119612 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-39b81931-6408-49b6-b1fa-98acbeab13a2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:40.126128 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-39b81931-6408-49b6-b1fa-98acbeab13a2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:40.126566 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-39b81931-6408-49b6-b1fa-98acbeab13a2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:40.127313 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-39b81931-6408-49b6-b1fa-98acbeab13a2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:40.127760 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-39b81931-6408-49b6-b1fa-98acbeab13a2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:40.256415 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-39b81931-6408-49b6-b1fa-98acbeab13a2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:40.264951 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-39b81931-6408-49b6-b1fa-98acbeab13a2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:40.266436 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-39b81931-6408-49b6-b1fa-98acbeab13a2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:40.267569 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-39b81931-6408-49b6-b1fa-98acbeab13a2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1723 microversion: 2.20 time: 0.152779 Oct 29 01:31:40.268164 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 234/477] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:31:40 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:31:40.382650 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-c04cc5ed-ef34-4b03-831b-b9af4920c9ce tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:40.383246 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-c04cc5ed-ef34-4b03-831b-b9af4920c9ce tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:40.389639 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c04cc5ed-ef34-4b03-831b-b9af4920c9ce tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:40.390082 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c04cc5ed-ef34-4b03-831b-b9af4920c9ce tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:40.391071 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c04cc5ed-ef34-4b03-831b-b9af4920c9ce tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:40.391299 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c04cc5ed-ef34-4b03-831b-b9af4920c9ce tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:40.513551 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-c04cc5ed-ef34-4b03-831b-b9af4920c9ce tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045dda1ff9b44334954c08e63fcd20c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51a2093a0874d52a08f6e25489ba181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:40.521552 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-c04cc5ed-ef34-4b03-831b-b9af4920c9ce tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92" status: 200 len: 1724 microversion: 2.1 time: 0.142845 Oct 29 01:31:40.522141 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 244/478] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:31:40 2021] GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92 => generated 1724 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:31:41.285992 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-c0e5dfd5-28a9-45c6-907b-8b20a4e2b286 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:41.287257 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-c0e5dfd5-28a9-45c6-907b-8b20a4e2b286 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:41.293589 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-c0e5dfd5-28a9-45c6-907b-8b20a4e2b286 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:41.294047 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-c0e5dfd5-28a9-45c6-907b-8b20a4e2b286 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:41.294829 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-c0e5dfd5-28a9-45c6-907b-8b20a4e2b286 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:41.295263 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-c0e5dfd5-28a9-45c6-907b-8b20a4e2b286 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:41.428689 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-c0e5dfd5-28a9-45c6-907b-8b20a4e2b286 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:41.436339 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-c0e5dfd5-28a9-45c6-907b-8b20a4e2b286 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:41.437842 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-c0e5dfd5-28a9-45c6-907b-8b20a4e2b286 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:41.439000 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-c0e5dfd5-28a9-45c6-907b-8b20a4e2b286 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1723 microversion: 2.20 time: 0.156814 Oct 29 01:31:41.440074 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 235/479] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:31:41 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:31:41.540698 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-e9e71642-5efd-43fe-8b4b-190fd78a0e80 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:41.542565 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-e9e71642-5efd-43fe-8b4b-190fd78a0e80 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:41.549495 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-e9e71642-5efd-43fe-8b4b-190fd78a0e80 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:41.550073 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-e9e71642-5efd-43fe-8b4b-190fd78a0e80 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:41.550983 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-e9e71642-5efd-43fe-8b4b-190fd78a0e80 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:41.551510 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-e9e71642-5efd-43fe-8b4b-190fd78a0e80 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:41.863155 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-e9e71642-5efd-43fe-8b4b-190fd78a0e80 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045dda1ff9b44334954c08e63fcd20c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51a2093a0874d52a08f6e25489ba181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:41.875501 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-e9e71642-5efd-43fe-8b4b-190fd78a0e80 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92" status: 200 len: 1724 microversion: 2.1 time: 0.340706 Oct 29 01:31:41.889070 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 245/480] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:31:41 2021] GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92 => generated 1724 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:31:42.458900 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-623bef5c-775a-4644-8f3b-689d21e4140f tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:42.459561 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-623bef5c-775a-4644-8f3b-689d21e4140f tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:42.470200 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-623bef5c-775a-4644-8f3b-689d21e4140f tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:42.470200 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-623bef5c-775a-4644-8f3b-689d21e4140f tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:42.470829 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-623bef5c-775a-4644-8f3b-689d21e4140f tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:42.471546 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-623bef5c-775a-4644-8f3b-689d21e4140f tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:42.697847 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-623bef5c-775a-4644-8f3b-689d21e4140f tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:42.706186 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-623bef5c-775a-4644-8f3b-689d21e4140f tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:42.707793 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-623bef5c-775a-4644-8f3b-689d21e4140f tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:42.709365 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-623bef5c-775a-4644-8f3b-689d21e4140f tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1723 microversion: 2.20 time: 0.254673 Oct 29 01:31:42.709973 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 236/481] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:31:42 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1723 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:31:42.892644 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-b23c1878-5ad3-4d8f-b6b4-c214c2cd347b tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:42.893247 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-b23c1878-5ad3-4d8f-b6b4-c214c2cd347b tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:42.899757 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-b23c1878-5ad3-4d8f-b6b4-c214c2cd347b tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:42.900204 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-b23c1878-5ad3-4d8f-b6b4-c214c2cd347b tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:42.900965 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-b23c1878-5ad3-4d8f-b6b4-c214c2cd347b tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:42.901405 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-b23c1878-5ad3-4d8f-b6b4-c214c2cd347b tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:43.050590 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-b23c1878-5ad3-4d8f-b6b4-c214c2cd347b tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045dda1ff9b44334954c08e63fcd20c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51a2093a0874d52a08f6e25489ba181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:43.059066 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-b23c1878-5ad3-4d8f-b6b4-c214c2cd347b tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92" status: 200 len: 1724 microversion: 2.1 time: 0.169983 Oct 29 01:31:43.059625 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 246/482] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:31:42 2021] GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:31:43.726467 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-37917c0b-b738-45a4-8a70-baee08184f8e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:43.726869 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-37917c0b-b738-45a4-8a70-baee08184f8e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:43.733353 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-37917c0b-b738-45a4-8a70-baee08184f8e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:43.733801 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-37917c0b-b738-45a4-8a70-baee08184f8e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:43.734660 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-37917c0b-b738-45a4-8a70-baee08184f8e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:43.735121 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-37917c0b-b738-45a4-8a70-baee08184f8e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:43.862235 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-37917c0b-b738-45a4-8a70-baee08184f8e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:43.871338 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-37917c0b-b738-45a4-8a70-baee08184f8e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:43.873752 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-37917c0b-b738-45a4-8a70-baee08184f8e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:43.874431 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-37917c0b-b738-45a4-8a70-baee08184f8e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1723 microversion: 2.20 time: 0.152076 Oct 29 01:31:43.874986 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 237/483] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:31:43 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:31:44.076152 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-37baa3e4-894c-4c18-99e3-1fc96f347c9c tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:44.076751 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-37baa3e4-894c-4c18-99e3-1fc96f347c9c tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:44.083081 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-37baa3e4-894c-4c18-99e3-1fc96f347c9c tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:44.083542 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-37baa3e4-894c-4c18-99e3-1fc96f347c9c tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:44.084402 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-37baa3e4-894c-4c18-99e3-1fc96f347c9c tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:44.084840 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-37baa3e4-894c-4c18-99e3-1fc96f347c9c tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:44.277036 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-37baa3e4-894c-4c18-99e3-1fc96f347c9c tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045dda1ff9b44334954c08e63fcd20c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51a2093a0874d52a08f6e25489ba181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:44.284931 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-37baa3e4-894c-4c18-99e3-1fc96f347c9c tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92" status: 200 len: 1724 microversion: 2.1 time: 0.212682 Oct 29 01:31:44.292922 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 247/484] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:31:44 2021] GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92 => generated 1724 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:31:44.892658 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-f942fd2a-7d4b-46f0-a40a-6883f36983f5 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:44.893253 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-f942fd2a-7d4b-46f0-a40a-6883f36983f5 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:44.899457 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-f942fd2a-7d4b-46f0-a40a-6883f36983f5 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:44.899928 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-f942fd2a-7d4b-46f0-a40a-6883f36983f5 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:44.900685 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-f942fd2a-7d4b-46f0-a40a-6883f36983f5 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:44.902085 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-f942fd2a-7d4b-46f0-a40a-6883f36983f5 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:45.027927 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-f942fd2a-7d4b-46f0-a40a-6883f36983f5 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:45.036135 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-f942fd2a-7d4b-46f0-a40a-6883f36983f5 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:45.038713 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-f942fd2a-7d4b-46f0-a40a-6883f36983f5 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:45.039475 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-f942fd2a-7d4b-46f0-a40a-6883f36983f5 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1723 microversion: 2.20 time: 0.150478 Oct 29 01:31:45.040150 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 238/485] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:31:44 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:31:45.303311 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-c1addabb-bb23-4bbe-a906-6ce5c88a2a88 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:45.303974 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-c1addabb-bb23-4bbe-a906-6ce5c88a2a88 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:45.310384 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c1addabb-bb23-4bbe-a906-6ce5c88a2a88 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:45.310820 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c1addabb-bb23-4bbe-a906-6ce5c88a2a88 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:45.311606 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c1addabb-bb23-4bbe-a906-6ce5c88a2a88 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:45.312066 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c1addabb-bb23-4bbe-a906-6ce5c88a2a88 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:45.439594 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-c1addabb-bb23-4bbe-a906-6ce5c88a2a88 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045dda1ff9b44334954c08e63fcd20c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51a2093a0874d52a08f6e25489ba181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:45.451811 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-c1addabb-bb23-4bbe-a906-6ce5c88a2a88 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92" status: 200 len: 1701 microversion: 2.1 time: 0.148336 Oct 29 01:31:45.451811 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 248/486] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:31:45 2021] GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92 => generated 1701 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:31:45.466679 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-7011d35a-bc46-4d8d-b842-5984ed3d7622 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:31:45.472523 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-7011d35a-bc46-4d8d-b842-5984ed3d7622 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:45.472966 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-7011d35a-bc46-4d8d-b842-5984ed3d7622 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:45.495093 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-7011d35a-bc46-4d8d-b842-5984ed3d7622 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Going to try to start instance {{(pid=116379) start /opt/stack/nova/nova/compute/api.py:2675}} Oct 29 01:31:45.685397 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-7011d35a-bc46-4d8d-b842-5984ed3d7622 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action" status: 202 len: 0 microversion: 2.1 time: 0.222253 Oct 29 01:31:45.686159 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 239/487] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:31:45 2021] POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:31:45.700125 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-3559a845-9c90-4a2c-a86e-d58e9dcf8533 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:45.700983 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-3559a845-9c90-4a2c-a86e-d58e9dcf8533 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:45.706986 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-3559a845-9c90-4a2c-a86e-d58e9dcf8533 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:45.708074 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-3559a845-9c90-4a2c-a86e-d58e9dcf8533 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:45.708973 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-3559a845-9c90-4a2c-a86e-d58e9dcf8533 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:45.709614 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-3559a845-9c90-4a2c-a86e-d58e9dcf8533 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:45.834016 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-3559a845-9c90-4a2c-a86e-d58e9dcf8533 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045dda1ff9b44334954c08e63fcd20c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51a2093a0874d52a08f6e25489ba181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:45.841885 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-3559a845-9c90-4a2c-a86e-d58e9dcf8533 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92" status: 200 len: 1710 microversion: 2.1 time: 0.145730 Oct 29 01:31:45.842452 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 249/488] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:31:45 2021] GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92 => generated 1710 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:31:46.058916 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-e5ff968c-1b20-456e-b4a3-66379b9ade54 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:46.059676 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-e5ff968c-1b20-456e-b4a3-66379b9ade54 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:46.066681 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-e5ff968c-1b20-456e-b4a3-66379b9ade54 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:46.067434 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-e5ff968c-1b20-456e-b4a3-66379b9ade54 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:46.068332 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-e5ff968c-1b20-456e-b4a3-66379b9ade54 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:46.068742 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-e5ff968c-1b20-456e-b4a3-66379b9ade54 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:46.195743 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-e5ff968c-1b20-456e-b4a3-66379b9ade54 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:46.203967 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-e5ff968c-1b20-456e-b4a3-66379b9ade54 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:46.205481 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-e5ff968c-1b20-456e-b4a3-66379b9ade54 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:46.206775 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-e5ff968c-1b20-456e-b4a3-66379b9ade54 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1723 microversion: 2.20 time: 0.152631 Oct 29 01:31:46.207378 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 240/489] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:31:46 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:31:46.860627 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-db1fcf0e-3f52-4f22-9b6a-fe4768a1116f tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:46.861232 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-db1fcf0e-3f52-4f22-9b6a-fe4768a1116f tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:46.871176 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-db1fcf0e-3f52-4f22-9b6a-fe4768a1116f tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:46.871176 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-db1fcf0e-3f52-4f22-9b6a-fe4768a1116f tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:46.871176 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-db1fcf0e-3f52-4f22-9b6a-fe4768a1116f tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:46.871176 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-db1fcf0e-3f52-4f22-9b6a-fe4768a1116f tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:47.031351 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-db1fcf0e-3f52-4f22-9b6a-fe4768a1116f tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045dda1ff9b44334954c08e63fcd20c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51a2093a0874d52a08f6e25489ba181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:47.039902 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-db1fcf0e-3f52-4f22-9b6a-fe4768a1116f tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92" status: 200 len: 1710 microversion: 2.1 time: 0.183136 Oct 29 01:31:47.040498 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 250/490] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:31:46 2021] GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92 => generated 1710 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:31:47.225506 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-137d4b6a-ae06-4d9b-83c7-5686a93a44fd tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:47.227523 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-137d4b6a-ae06-4d9b-83c7-5686a93a44fd tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:47.234274 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-137d4b6a-ae06-4d9b-83c7-5686a93a44fd tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:47.234801 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-137d4b6a-ae06-4d9b-83c7-5686a93a44fd tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:47.235653 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-137d4b6a-ae06-4d9b-83c7-5686a93a44fd tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:47.236327 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-137d4b6a-ae06-4d9b-83c7-5686a93a44fd tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:47.429107 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-137d4b6a-ae06-4d9b-83c7-5686a93a44fd tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:47.440153 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-137d4b6a-ae06-4d9b-83c7-5686a93a44fd tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:47.443049 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-137d4b6a-ae06-4d9b-83c7-5686a93a44fd tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:47.445230 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-137d4b6a-ae06-4d9b-83c7-5686a93a44fd tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1723 microversion: 2.20 time: 0.223572 Oct 29 01:31:47.446329 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 241/491] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:31:47 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1723 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:31:48.057368 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-33cc39a7-1576-4489-bec8-1fa459ee2c9c tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:48.059046 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-33cc39a7-1576-4489-bec8-1fa459ee2c9c tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:48.066493 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-33cc39a7-1576-4489-bec8-1fa459ee2c9c tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:48.066901 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-33cc39a7-1576-4489-bec8-1fa459ee2c9c tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:48.068782 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-33cc39a7-1576-4489-bec8-1fa459ee2c9c tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:48.069359 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-33cc39a7-1576-4489-bec8-1fa459ee2c9c tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:48.198087 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-33cc39a7-1576-4489-bec8-1fa459ee2c9c tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045dda1ff9b44334954c08e63fcd20c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51a2093a0874d52a08f6e25489ba181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:48.206576 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-33cc39a7-1576-4489-bec8-1fa459ee2c9c tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92" status: 200 len: 1710 microversion: 2.1 time: 0.153738 Oct 29 01:31:48.210791 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 251/492] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:31:48 2021] GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92 => generated 1710 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:31:48.464176 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-ad2a9d35-82a9-4ed7-ba95-f496bb5b0303 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:48.465183 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-ad2a9d35-82a9-4ed7-ba95-f496bb5b0303 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:48.471838 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-ad2a9d35-82a9-4ed7-ba95-f496bb5b0303 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:48.472387 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-ad2a9d35-82a9-4ed7-ba95-f496bb5b0303 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:48.473319 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-ad2a9d35-82a9-4ed7-ba95-f496bb5b0303 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:48.473859 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-ad2a9d35-82a9-4ed7-ba95-f496bb5b0303 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:48.615483 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-ad2a9d35-82a9-4ed7-ba95-f496bb5b0303 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:48.623456 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-ad2a9d35-82a9-4ed7-ba95-f496bb5b0303 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:48.624924 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-ad2a9d35-82a9-4ed7-ba95-f496bb5b0303 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:48.626069 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-ad2a9d35-82a9-4ed7-ba95-f496bb5b0303 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1744 microversion: 2.20 time: 0.166252 Oct 29 01:31:48.626616 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 242/493] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:31:48 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1744 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:31:49.224337 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-63aed176-fc92-4abf-9371-6f6441c6fc9d tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:49.224960 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-63aed176-fc92-4abf-9371-6f6441c6fc9d tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:49.231288 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-63aed176-fc92-4abf-9371-6f6441c6fc9d tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:49.231835 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-63aed176-fc92-4abf-9371-6f6441c6fc9d tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:49.232526 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-63aed176-fc92-4abf-9371-6f6441c6fc9d tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:49.232957 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-63aed176-fc92-4abf-9371-6f6441c6fc9d tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:49.358188 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-63aed176-fc92-4abf-9371-6f6441c6fc9d tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045dda1ff9b44334954c08e63fcd20c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51a2093a0874d52a08f6e25489ba181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:49.366831 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-63aed176-fc92-4abf-9371-6f6441c6fc9d tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92" status: 200 len: 1714 microversion: 2.1 time: 0.145297 Oct 29 01:31:49.367358 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 252/494] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:31:49 2021] GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92 => generated 1714 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:31:49.646373 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-d856478a-57dd-454a-8087-ae5f422ea748 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:49.646969 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-d856478a-57dd-454a-8087-ae5f422ea748 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:49.653729 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d856478a-57dd-454a-8087-ae5f422ea748 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:49.654170 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d856478a-57dd-454a-8087-ae5f422ea748 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:49.654939 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d856478a-57dd-454a-8087-ae5f422ea748 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:49.655372 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d856478a-57dd-454a-8087-ae5f422ea748 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:49.783869 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-d856478a-57dd-454a-8087-ae5f422ea748 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:49.792466 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-d856478a-57dd-454a-8087-ae5f422ea748 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:49.793970 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-d856478a-57dd-454a-8087-ae5f422ea748 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:49.795127 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-d856478a-57dd-454a-8087-ae5f422ea748 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1744 microversion: 2.20 time: 0.152622 Oct 29 01:31:49.802753 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 243/495] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:31:49 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1744 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:31:50.813791 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-a0b322bf-7cab-4c1f-9ecb-e443f5a3eefe tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:50.814401 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-a0b322bf-7cab-4c1f-9ecb-e443f5a3eefe tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:50.820734 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a0b322bf-7cab-4c1f-9ecb-e443f5a3eefe tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:50.821178 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a0b322bf-7cab-4c1f-9ecb-e443f5a3eefe tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:50.821934 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a0b322bf-7cab-4c1f-9ecb-e443f5a3eefe tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:50.822411 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a0b322bf-7cab-4c1f-9ecb-e443f5a3eefe tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:50.942655 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-a0b322bf-7cab-4c1f-9ecb-e443f5a3eefe tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:50.951247 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-a0b322bf-7cab-4c1f-9ecb-e443f5a3eefe tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:50.952793 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-a0b322bf-7cab-4c1f-9ecb-e443f5a3eefe tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:50.954021 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-a0b322bf-7cab-4c1f-9ecb-e443f5a3eefe tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1744 microversion: 2.20 time: 0.143981 Oct 29 01:31:50.954583 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 253/496] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:31:50 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1744 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:31:51.320225 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-4d834281-7a83-4c3b-b3f8-03a3060ebf3c tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:31:51.321218 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-4d834281-7a83-4c3b-b3f8-03a3060ebf3c tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:51.327673 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-4d834281-7a83-4c3b-b3f8-03a3060ebf3c tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:51.328161 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-4d834281-7a83-4c3b-b3f8-03a3060ebf3c tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:51.328905 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-4d834281-7a83-4c3b-b3f8-03a3060ebf3c tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:51.329328 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-4d834281-7a83-4c3b-b3f8-03a3060ebf3c tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:51.352525 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.objects.instance [None req-4d834281-7a83-4c3b-b3f8-03a3060ebf3c tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lazy-loading 'flavor' on Instance uuid 09875e40-e63d-4175-9361-fd9439c0c7ca {{(pid=116379) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 01:31:51.674901 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-4d834281-7a83-4c3b-b3f8-03a3060ebf3c tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "POST /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca/action" status: 200 len: 32 microversion: 2.1 time: 0.358647 Oct 29 01:31:51.675518 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 244/497] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:31:51 2021] POST /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca/action => generated 32 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:31:51.684653 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-bdbb68ce-ca6f-4e12-8680-f160d8d814b3 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:51.685258 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-bdbb68ce-ca6f-4e12-8680-f160d8d814b3 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:51.691235 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-bdbb68ce-ca6f-4e12-8680-f160d8d814b3 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:51.691682 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-bdbb68ce-ca6f-4e12-8680-f160d8d814b3 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:51.692478 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-bdbb68ce-ca6f-4e12-8680-f160d8d814b3 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:51.692911 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-bdbb68ce-ca6f-4e12-8680-f160d8d814b3 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:51.814739 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-bdbb68ce-ca6f-4e12-8680-f160d8d814b3 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:51.824131 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-bdbb68ce-ca6f-4e12-8680-f160d8d814b3 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca" status: 200 len: 1566 microversion: 2.1 time: 0.143241 Oct 29 01:31:51.824702 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 254/498] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:31:51 2021] GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca => generated 1566 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:31:51.973181 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-0ea65328-c233-4b1b-9ae1-dd8abcbb8e66 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:51.973896 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-0ea65328-c233-4b1b-9ae1-dd8abcbb8e66 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:51.981171 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-0ea65328-c233-4b1b-9ae1-dd8abcbb8e66 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:51.981616 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-0ea65328-c233-4b1b-9ae1-dd8abcbb8e66 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:51.982441 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-0ea65328-c233-4b1b-9ae1-dd8abcbb8e66 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:51.982874 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-0ea65328-c233-4b1b-9ae1-dd8abcbb8e66 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:52.115611 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-0ea65328-c233-4b1b-9ae1-dd8abcbb8e66 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:52.124004 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-0ea65328-c233-4b1b-9ae1-dd8abcbb8e66 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:52.125491 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-0ea65328-c233-4b1b-9ae1-dd8abcbb8e66 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:52.126639 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-0ea65328-c233-4b1b-9ae1-dd8abcbb8e66 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1744 microversion: 2.20 time: 0.157794 Oct 29 01:31:52.127200 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 245/499] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:31:51 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1744 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:31:52.842212 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-0804948f-c278-49f6-b852-ccf0b2061e28 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:52.842765 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-0804948f-c278-49f6-b852-ccf0b2061e28 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:52.848938 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-0804948f-c278-49f6-b852-ccf0b2061e28 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:52.849372 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-0804948f-c278-49f6-b852-ccf0b2061e28 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:52.850125 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-0804948f-c278-49f6-b852-ccf0b2061e28 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:52.850554 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-0804948f-c278-49f6-b852-ccf0b2061e28 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:52.971819 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-0804948f-c278-49f6-b852-ccf0b2061e28 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:52.980191 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-0804948f-c278-49f6-b852-ccf0b2061e28 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca" status: 200 len: 1566 microversion: 2.1 time: 0.141849 Oct 29 01:31:52.980758 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 255/500] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:31:52 2021] GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca => generated 1566 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:31:53.145641 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-07c4efad-4f77-439e-969e-88453e5d1c64 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:53.146253 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-07c4efad-4f77-439e-969e-88453e5d1c64 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:53.153717 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-07c4efad-4f77-439e-969e-88453e5d1c64 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:53.153976 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-07c4efad-4f77-439e-969e-88453e5d1c64 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:53.154747 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-07c4efad-4f77-439e-969e-88453e5d1c64 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:53.155173 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-07c4efad-4f77-439e-969e-88453e5d1c64 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:53.301352 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-07c4efad-4f77-439e-969e-88453e5d1c64 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:53.311506 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-07c4efad-4f77-439e-969e-88453e5d1c64 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:53.313667 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-07c4efad-4f77-439e-969e-88453e5d1c64 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:53.315267 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-07c4efad-4f77-439e-969e-88453e5d1c64 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1744 microversion: 2.20 time: 0.173436 Oct 29 01:31:53.329753 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 246/501] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:31:53 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1744 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:31:53.997481 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-c5f373e7-267c-420d-8dd1-06b29fb36695 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:53.998031 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-c5f373e7-267c-420d-8dd1-06b29fb36695 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:54.004181 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c5f373e7-267c-420d-8dd1-06b29fb36695 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:54.004617 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c5f373e7-267c-420d-8dd1-06b29fb36695 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:54.005380 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c5f373e7-267c-420d-8dd1-06b29fb36695 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:54.005806 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c5f373e7-267c-420d-8dd1-06b29fb36695 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:54.140249 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-c5f373e7-267c-420d-8dd1-06b29fb36695 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:54.150176 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-c5f373e7-267c-420d-8dd1-06b29fb36695 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca" status: 200 len: 1566 microversion: 2.1 time: 0.156321 Oct 29 01:31:54.150835 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 256/502] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:31:53 2021] GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:31:54.342911 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-78a07ee4-4cab-409e-a6df-f4cb1e269480 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:54.343320 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-78a07ee4-4cab-409e-a6df-f4cb1e269480 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:54.349922 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-78a07ee4-4cab-409e-a6df-f4cb1e269480 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:54.350382 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-78a07ee4-4cab-409e-a6df-f4cb1e269480 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:54.352436 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-78a07ee4-4cab-409e-a6df-f4cb1e269480 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:54.352877 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-78a07ee4-4cab-409e-a6df-f4cb1e269480 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:54.488516 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-78a07ee4-4cab-409e-a6df-f4cb1e269480 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:54.496422 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-78a07ee4-4cab-409e-a6df-f4cb1e269480 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:54.498184 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-78a07ee4-4cab-409e-a6df-f4cb1e269480 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:54.499445 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-78a07ee4-4cab-409e-a6df-f4cb1e269480 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1739 microversion: 2.20 time: 0.161242 Oct 29 01:31:54.499974 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 247/503] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:31:54 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1739 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:31:55.168085 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-6f634421-22df-454f-bd5f-19c995ed5811 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:55.169301 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-6f634421-22df-454f-bd5f-19c995ed5811 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:55.176632 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-6f634421-22df-454f-bd5f-19c995ed5811 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:55.177268 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-6f634421-22df-454f-bd5f-19c995ed5811 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:55.178190 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-6f634421-22df-454f-bd5f-19c995ed5811 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:55.178802 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-6f634421-22df-454f-bd5f-19c995ed5811 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:55.351405 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-6f634421-22df-454f-bd5f-19c995ed5811 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:55.376104 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-6f634421-22df-454f-bd5f-19c995ed5811 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca" status: 200 len: 1566 microversion: 2.1 time: 0.208517 Oct 29 01:31:55.377046 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 257/504] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:31:55 2021] GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca => generated 1566 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:31:55.408892 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [req-f8f83512-4ecc-4d05-b6a2-ca0a38c80002 req-19321258-0dda-4e92-b91b-d0ec1f261722 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f64f5ebf-8af1-4507-849e-b7d8e33979ae", "name": "network-vif-plugged", "status": "completed", "tag": "01153800-bf44-4376-854e-aec24743a4d7"}]} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:31:55.410598 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:31:55.410598 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: warnings.warn(msg) Oct 29 01:31:55.419171 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [req-f8f83512-4ecc-4d05-b6a2-ca0a38c80002 req-19321258-0dda-4e92-b91b-d0ec1f261722 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:55.419829 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [req-f8f83512-4ecc-4d05-b6a2-ca0a38c80002 req-19321258-0dda-4e92-b91b-d0ec1f261722 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:55.436799 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.compute.server_external_events [req-f8f83512-4ecc-4d05-b6a2-ca0a38c80002 req-19321258-0dda-4e92-b91b-d0ec1f261722 service nova] Creating event network-vif-plugged:01153800-bf44-4376-854e-aec24743a4d7 for instance f64f5ebf-8af1-4507-849e-b7d8e33979ae on hv-cinder-81398 Oct 29 01:31:55.442328 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [req-f8f83512-4ecc-4d05-b6a2-ca0a38c80002 req-19321258-0dda-4e92-b91b-d0ec1f261722 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037054 Oct 29 01:31:55.443597 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 248/505] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Oct 29 01:31:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:31:55.518797 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-9f4c3d09-6dea-489a-b02c-5141c32f3f86 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:55.519881 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-9f4c3d09-6dea-489a-b02c-5141c32f3f86 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:55.544700 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-9f4c3d09-6dea-489a-b02c-5141c32f3f86 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:55.545146 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-9f4c3d09-6dea-489a-b02c-5141c32f3f86 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:55.545920 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-9f4c3d09-6dea-489a-b02c-5141c32f3f86 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:55.546359 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-9f4c3d09-6dea-489a-b02c-5141c32f3f86 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:55.726115 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-9f4c3d09-6dea-489a-b02c-5141c32f3f86 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:55.735366 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-9f4c3d09-6dea-489a-b02c-5141c32f3f86 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:55.737000 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-9f4c3d09-6dea-489a-b02c-5141c32f3f86 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:55.738448 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-9f4c3d09-6dea-489a-b02c-5141c32f3f86 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1739 microversion: 2.20 time: 0.223709 Oct 29 01:31:55.739522 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 258/506] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:31:55 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1739 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:31:56.394006 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-3ef78119-74b8-4fb9-b20f-3573fa8d25f2 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:56.394695 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-3ef78119-74b8-4fb9-b20f-3573fa8d25f2 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:56.413515 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-3ef78119-74b8-4fb9-b20f-3573fa8d25f2 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:56.413515 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-3ef78119-74b8-4fb9-b20f-3573fa8d25f2 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:56.413515 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-3ef78119-74b8-4fb9-b20f-3573fa8d25f2 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:56.413515 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-3ef78119-74b8-4fb9-b20f-3573fa8d25f2 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:56.573895 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-3ef78119-74b8-4fb9-b20f-3573fa8d25f2 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:56.584734 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-3ef78119-74b8-4fb9-b20f-3573fa8d25f2 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca" status: 200 len: 1566 microversion: 2.1 time: 0.194638 Oct 29 01:31:56.591675 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 249/507] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:31:56 2021] GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca => generated 1566 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:31:56.848771 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-4843184b-aada-41f7-952c-e2d2358df4b6 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:56.848771 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-4843184b-aada-41f7-952c-e2d2358df4b6 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:56.848771 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4843184b-aada-41f7-952c-e2d2358df4b6 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:56.848771 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4843184b-aada-41f7-952c-e2d2358df4b6 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:56.850160 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4843184b-aada-41f7-952c-e2d2358df4b6 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:56.850160 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4843184b-aada-41f7-952c-e2d2358df4b6 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:57.006463 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-4843184b-aada-41f7-952c-e2d2358df4b6 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:57.024312 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-4843184b-aada-41f7-952c-e2d2358df4b6 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:57.024423 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-4843184b-aada-41f7-952c-e2d2358df4b6 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:57.025631 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-4843184b-aada-41f7-952c-e2d2358df4b6 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1739 microversion: 2.20 time: 0.266581 Oct 29 01:31:57.026518 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 259/508] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:31:56 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1739 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:31:57.604574 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-f8f2de96-dbc0-45e2-ab97-b624b77c364e tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:57.605186 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-f8f2de96-dbc0-45e2-ab97-b624b77c364e tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:57.610962 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-f8f2de96-dbc0-45e2-ab97-b624b77c364e tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:57.611401 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-f8f2de96-dbc0-45e2-ab97-b624b77c364e tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:57.612185 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-f8f2de96-dbc0-45e2-ab97-b624b77c364e tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:57.612613 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-f8f2de96-dbc0-45e2-ab97-b624b77c364e tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:57.735109 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-f8f2de96-dbc0-45e2-ab97-b624b77c364e tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:57.742766 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-f8f2de96-dbc0-45e2-ab97-b624b77c364e tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca" status: 200 len: 1566 microversion: 2.1 time: 0.144152 Oct 29 01:31:57.743317 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 250/509] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:31:57 2021] GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca => generated 1566 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:31:58.044431 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-4a20f8cb-2126-4804-a57c-c0b4260d401a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:58.045280 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-4a20f8cb-2126-4804-a57c-c0b4260d401a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:58.052408 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4a20f8cb-2126-4804-a57c-c0b4260d401a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:58.059783 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4a20f8cb-2126-4804-a57c-c0b4260d401a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:58.061011 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4a20f8cb-2126-4804-a57c-c0b4260d401a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:58.061732 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4a20f8cb-2126-4804-a57c-c0b4260d401a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:58.214935 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-4a20f8cb-2126-4804-a57c-c0b4260d401a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:58.224228 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-4a20f8cb-2126-4804-a57c-c0b4260d401a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:58.227370 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-4a20f8cb-2126-4804-a57c-c0b4260d401a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:58.231689 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-4a20f8cb-2126-4804-a57c-c0b4260d401a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1739 microversion: 2.20 time: 0.190548 Oct 29 01:31:58.247166 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 260/510] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:31:58 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1739 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:31:58.763606 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-a14c5606-f5be-496e-8612-d9f70724509b tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:58.767236 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-a14c5606-f5be-496e-8612-d9f70724509b tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:58.774217 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-a14c5606-f5be-496e-8612-d9f70724509b tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:58.774657 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-a14c5606-f5be-496e-8612-d9f70724509b tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:58.775427 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-a14c5606-f5be-496e-8612-d9f70724509b tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:58.775882 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-a14c5606-f5be-496e-8612-d9f70724509b tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:58.945600 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-a14c5606-f5be-496e-8612-d9f70724509b tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:58.954644 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-a14c5606-f5be-496e-8612-d9f70724509b tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca" status: 200 len: 1566 microversion: 2.1 time: 0.197666 Oct 29 01:31:58.955575 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 251/511] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:31:58 2021] GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca => generated 1566 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:31:59.253392 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-4a726e50-3ea2-4d6c-857f-b9c7c80e5231 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:59.254109 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-4a726e50-3ea2-4d6c-857f-b9c7c80e5231 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:59.261270 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4a726e50-3ea2-4d6c-857f-b9c7c80e5231 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:59.261981 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4a726e50-3ea2-4d6c-857f-b9c7c80e5231 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:59.262991 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4a726e50-3ea2-4d6c-857f-b9c7c80e5231 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:59.263621 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4a726e50-3ea2-4d6c-857f-b9c7c80e5231 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:59.423687 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-4a726e50-3ea2-4d6c-857f-b9c7c80e5231 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:59.432933 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-4a726e50-3ea2-4d6c-857f-b9c7c80e5231 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:59.434493 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-4a726e50-3ea2-4d6c-857f-b9c7c80e5231 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:31:59.435637 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-4a726e50-3ea2-4d6c-857f-b9c7c80e5231 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1739 microversion: 2.20 time: 0.186225 Oct 29 01:31:59.447021 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 261/512] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:31:59 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1739 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:31:59.972755 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-77f97d87-3d35-4b93-9261-69e9ac82c86f tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:31:59.973409 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-77f97d87-3d35-4b93-9261-69e9ac82c86f tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:31:59.981640 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-77f97d87-3d35-4b93-9261-69e9ac82c86f tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:59.982355 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-77f97d87-3d35-4b93-9261-69e9ac82c86f tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:31:59.983304 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-77f97d87-3d35-4b93-9261-69e9ac82c86f tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:31:59.983754 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-77f97d87-3d35-4b93-9261-69e9ac82c86f tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:00.146701 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-77f97d87-3d35-4b93-9261-69e9ac82c86f tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:00.168143 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-77f97d87-3d35-4b93-9261-69e9ac82c86f tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca" status: 200 len: 1566 microversion: 2.1 time: 0.199466 Oct 29 01:32:00.173658 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 252/513] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:31:59 2021] GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca => generated 1566 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:32:00.457171 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-3cd89b79-beec-414d-ae8a-ad19490f884b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:00.457171 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-3cd89b79-beec-414d-ae8a-ad19490f884b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:00.465263 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-3cd89b79-beec-414d-ae8a-ad19490f884b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:00.465889 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-3cd89b79-beec-414d-ae8a-ad19490f884b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:00.467106 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-3cd89b79-beec-414d-ae8a-ad19490f884b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:00.467697 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-3cd89b79-beec-414d-ae8a-ad19490f884b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:00.630033 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-3cd89b79-beec-414d-ae8a-ad19490f884b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:00.639215 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-3cd89b79-beec-414d-ae8a-ad19490f884b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:00.640896 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-3cd89b79-beec-414d-ae8a-ad19490f884b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:00.642129 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-3cd89b79-beec-414d-ae8a-ad19490f884b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1739 microversion: 2.20 time: 0.191473 Oct 29 01:32:00.642728 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 262/514] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:32:00 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1739 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:32:01.185869 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-bdf3479a-df0d-40b7-aca8-706c342779aa tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:01.186496 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-bdf3479a-df0d-40b7-aca8-706c342779aa tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:01.192737 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-bdf3479a-df0d-40b7-aca8-706c342779aa tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:01.193180 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-bdf3479a-df0d-40b7-aca8-706c342779aa tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:01.193938 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-bdf3479a-df0d-40b7-aca8-706c342779aa tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:01.194540 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-bdf3479a-df0d-40b7-aca8-706c342779aa tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:01.329144 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-bdf3479a-df0d-40b7-aca8-706c342779aa tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:01.338506 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-bdf3479a-df0d-40b7-aca8-706c342779aa tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca" status: 200 len: 1566 microversion: 2.1 time: 0.156291 Oct 29 01:32:01.339079 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 253/515] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:01 2021] GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:32:01.662290 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-4ce378bc-e517-43d6-97dd-a1b9ffd1b74b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:01.665278 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-4ce378bc-e517-43d6-97dd-a1b9ffd1b74b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:01.671481 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4ce378bc-e517-43d6-97dd-a1b9ffd1b74b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:01.671955 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4ce378bc-e517-43d6-97dd-a1b9ffd1b74b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:01.672899 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4ce378bc-e517-43d6-97dd-a1b9ffd1b74b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:01.673316 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4ce378bc-e517-43d6-97dd-a1b9ffd1b74b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:01.805398 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-4ce378bc-e517-43d6-97dd-a1b9ffd1b74b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:01.814061 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-4ce378bc-e517-43d6-97dd-a1b9ffd1b74b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:01.815906 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-4ce378bc-e517-43d6-97dd-a1b9ffd1b74b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:01.817058 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-4ce378bc-e517-43d6-97dd-a1b9ffd1b74b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1739 microversion: 2.20 time: 0.158653 Oct 29 01:32:01.817605 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 263/516] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:32:01 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1739 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:32:02.355069 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-eea12554-f31a-49db-a402-1fc3513493f4 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:02.355793 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-eea12554-f31a-49db-a402-1fc3513493f4 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:02.362183 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-eea12554-f31a-49db-a402-1fc3513493f4 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:02.362718 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-eea12554-f31a-49db-a402-1fc3513493f4 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:02.363556 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-eea12554-f31a-49db-a402-1fc3513493f4 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:02.364107 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-eea12554-f31a-49db-a402-1fc3513493f4 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:02.500820 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-eea12554-f31a-49db-a402-1fc3513493f4 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:02.510145 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-eea12554-f31a-49db-a402-1fc3513493f4 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca" status: 200 len: 1566 microversion: 2.1 time: 0.158636 Oct 29 01:32:02.510956 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 254/517] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:02 2021] GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca => generated 1566 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:32:02.835565 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-e93ef4a3-ed39-424f-ae64-ade82e7f60b7 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:02.836784 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-e93ef4a3-ed39-424f-ae64-ade82e7f60b7 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:02.843933 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-e93ef4a3-ed39-424f-ae64-ade82e7f60b7 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:02.844552 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-e93ef4a3-ed39-424f-ae64-ade82e7f60b7 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:02.845493 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-e93ef4a3-ed39-424f-ae64-ade82e7f60b7 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:02.845912 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-e93ef4a3-ed39-424f-ae64-ade82e7f60b7 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:02.990238 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-e93ef4a3-ed39-424f-ae64-ade82e7f60b7 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:02.999426 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-e93ef4a3-ed39-424f-ae64-ade82e7f60b7 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:03.007227 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-e93ef4a3-ed39-424f-ae64-ade82e7f60b7 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:03.007227 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-e93ef4a3-ed39-424f-ae64-ade82e7f60b7 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1739 microversion: 2.20 time: 0.173714 Oct 29 01:32:03.007227 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 264/518] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:32:02 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1739 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:32:03.529233 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-523af7b1-a809-44f1-b69b-a76fc030c0c3 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:03.529848 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-523af7b1-a809-44f1-b69b-a76fc030c0c3 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:03.536580 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-523af7b1-a809-44f1-b69b-a76fc030c0c3 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:03.537032 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-523af7b1-a809-44f1-b69b-a76fc030c0c3 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:03.538522 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-523af7b1-a809-44f1-b69b-a76fc030c0c3 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:03.539317 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-523af7b1-a809-44f1-b69b-a76fc030c0c3 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:03.702533 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-523af7b1-a809-44f1-b69b-a76fc030c0c3 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:03.710730 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-523af7b1-a809-44f1-b69b-a76fc030c0c3 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca" status: 200 len: 1566 microversion: 2.1 time: 0.185660 Oct 29 01:32:03.711991 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 255/519] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:03 2021] GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca => generated 1566 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:32:04.024725 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-4b7afdfc-2e68-4152-b5a4-f96139e5afcb tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:04.025437 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-4b7afdfc-2e68-4152-b5a4-f96139e5afcb tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:04.031650 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4b7afdfc-2e68-4152-b5a4-f96139e5afcb tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:04.032127 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4b7afdfc-2e68-4152-b5a4-f96139e5afcb tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:04.032892 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4b7afdfc-2e68-4152-b5a4-f96139e5afcb tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:04.033323 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4b7afdfc-2e68-4152-b5a4-f96139e5afcb tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:04.166575 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-4b7afdfc-2e68-4152-b5a4-f96139e5afcb tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:04.174608 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-4b7afdfc-2e68-4152-b5a4-f96139e5afcb tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:04.176446 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-4b7afdfc-2e68-4152-b5a4-f96139e5afcb tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:04.177752 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-4b7afdfc-2e68-4152-b5a4-f96139e5afcb tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1739 microversion: 2.20 time: 0.157310 Oct 29 01:32:04.178399 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 265/520] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:32:04 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1739 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:32:04.727706 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-aed1e3aa-21fa-4f02-96b3-02879aa0bfb0 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:04.728538 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-aed1e3aa-21fa-4f02-96b3-02879aa0bfb0 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:04.737006 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-aed1e3aa-21fa-4f02-96b3-02879aa0bfb0 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:04.737364 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-aed1e3aa-21fa-4f02-96b3-02879aa0bfb0 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:04.738382 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-aed1e3aa-21fa-4f02-96b3-02879aa0bfb0 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:04.738808 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-aed1e3aa-21fa-4f02-96b3-02879aa0bfb0 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:04.920581 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-aed1e3aa-21fa-4f02-96b3-02879aa0bfb0 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:04.929446 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-aed1e3aa-21fa-4f02-96b3-02879aa0bfb0 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca" status: 200 len: 1566 microversion: 2.1 time: 0.205911 Oct 29 01:32:04.930603 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 256/521] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:04 2021] GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca => generated 1566 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:32:05.196441 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-8c64db5d-efd3-4120-94fd-172185c918e5 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:05.197744 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-8c64db5d-efd3-4120-94fd-172185c918e5 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:05.205121 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-8c64db5d-efd3-4120-94fd-172185c918e5 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:05.205572 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-8c64db5d-efd3-4120-94fd-172185c918e5 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:05.206390 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-8c64db5d-efd3-4120-94fd-172185c918e5 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:05.206823 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-8c64db5d-efd3-4120-94fd-172185c918e5 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:05.344951 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-8c64db5d-efd3-4120-94fd-172185c918e5 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:05.353109 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-8c64db5d-efd3-4120-94fd-172185c918e5 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:05.354659 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-8c64db5d-efd3-4120-94fd-172185c918e5 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:05.355834 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-8c64db5d-efd3-4120-94fd-172185c918e5 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1739 microversion: 2.20 time: 0.163887 Oct 29 01:32:05.356412 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 266/522] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:32:05 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1739 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:32:05.946315 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-b31065ef-02a1-4c23-a4b0-4a34a1c82731 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:05.946911 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-b31065ef-02a1-4c23-a4b0-4a34a1c82731 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:05.954019 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-b31065ef-02a1-4c23-a4b0-4a34a1c82731 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:05.954400 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-b31065ef-02a1-4c23-a4b0-4a34a1c82731 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:05.955416 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-b31065ef-02a1-4c23-a4b0-4a34a1c82731 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:05.956055 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-b31065ef-02a1-4c23-a4b0-4a34a1c82731 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:06.096851 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-b31065ef-02a1-4c23-a4b0-4a34a1c82731 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:06.106438 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-b31065ef-02a1-4c23-a4b0-4a34a1c82731 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca" status: 200 len: 1566 microversion: 2.1 time: 0.163990 Oct 29 01:32:06.107965 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 257/523] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:05 2021] GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca => generated 1566 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:32:06.374593 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-ae23a251-4c1e-41f0-8db1-dce32650429d tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:06.375207 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-ae23a251-4c1e-41f0-8db1-dce32650429d tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:06.384199 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ae23a251-4c1e-41f0-8db1-dce32650429d tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:06.384510 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ae23a251-4c1e-41f0-8db1-dce32650429d tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:06.385327 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ae23a251-4c1e-41f0-8db1-dce32650429d tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:06.385780 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ae23a251-4c1e-41f0-8db1-dce32650429d tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:06.527688 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-ae23a251-4c1e-41f0-8db1-dce32650429d tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:06.535986 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-ae23a251-4c1e-41f0-8db1-dce32650429d tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:06.537720 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-ae23a251-4c1e-41f0-8db1-dce32650429d tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:06.538940 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-ae23a251-4c1e-41f0-8db1-dce32650429d tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1739 microversion: 2.20 time: 0.168253 Oct 29 01:32:06.539507 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 267/524] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:32:06 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1739 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:32:07.016037 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-fc50f475-f28d-4490-a46b-e9ad4b8e27cd tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:07.016726 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-fc50f475-f28d-4490-a46b-e9ad4b8e27cd tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] [instance: 93f60f90-a29b-4ae7-b9dc-ec821e4c7e10] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:07.023472 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-fc50f475-f28d-4490-a46b-e9ad4b8e27cd tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:07.023999 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-fc50f475-f28d-4490-a46b-e9ad4b8e27cd tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:07.024968 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-fc50f475-f28d-4490-a46b-e9ad4b8e27cd tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:07.025395 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-fc50f475-f28d-4490-a46b-e9ad4b8e27cd tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:07.126863 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-592bff0d-e0e8-409d-8e1a-b4c8f9c513ca tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:07.128068 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-592bff0d-e0e8-409d-8e1a-b4c8f9c513ca tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:07.137645 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-592bff0d-e0e8-409d-8e1a-b4c8f9c513ca tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:07.137645 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-592bff0d-e0e8-409d-8e1a-b4c8f9c513ca tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:07.137645 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-592bff0d-e0e8-409d-8e1a-b4c8f9c513ca tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:07.138204 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-592bff0d-e0e8-409d-8e1a-b4c8f9c513ca tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:07.158077 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.objects.instance [None req-fc50f475-f28d-4490-a46b-e9ad4b8e27cd tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lazy-loading 'services' on Instance uuid 93f60f90-a29b-4ae7-b9dc-ec821e4c7e10 {{(pid=116379) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 01:32:07.277083 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-592bff0d-e0e8-409d-8e1a-b4c8f9c513ca tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:07.284927 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-592bff0d-e0e8-409d-8e1a-b4c8f9c513ca tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca" status: 200 len: 1566 microversion: 2.1 time: 0.163721 Oct 29 01:32:07.285512 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 268/525] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:07 2021] GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca => generated 1566 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:32:07.430661 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-fc50f475-f28d-4490-a46b-e9ad4b8e27cd tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] 10.222.0.87 "DELETE /compute/v2.1/servers/93f60f90-a29b-4ae7-b9dc-ec821e4c7e10/os-volume_attachments/95cb5978-8c41-4087-8b63-101de93c9e49" status: 202 len: 0 microversion: 2.1 time: 0.418295 Oct 29 01:32:07.431272 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 258/526] 10.222.0.87 () {58 vars in 1415 bytes} [Fri Oct 29 01:32:07 2021] DELETE /compute/v2.1/servers/93f60f90-a29b-4ae7-b9dc-ec821e4c7e10/os-volume_attachments/95cb5978-8c41-4087-8b63-101de93c9e49 => generated 0 bytes in 420 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:32:07.558470 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-51b63cbe-e2e7-4f74-b5a6-aff37679a274 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:07.559071 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-51b63cbe-e2e7-4f74-b5a6-aff37679a274 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:07.567215 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-51b63cbe-e2e7-4f74-b5a6-aff37679a274 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:07.567802 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-51b63cbe-e2e7-4f74-b5a6-aff37679a274 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:07.569285 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-51b63cbe-e2e7-4f74-b5a6-aff37679a274 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:07.570449 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-51b63cbe-e2e7-4f74-b5a6-aff37679a274 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:07.702787 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-51b63cbe-e2e7-4f74-b5a6-aff37679a274 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:07.712099 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-51b63cbe-e2e7-4f74-b5a6-aff37679a274 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:07.713746 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-51b63cbe-e2e7-4f74-b5a6-aff37679a274 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:07.715040 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-51b63cbe-e2e7-4f74-b5a6-aff37679a274 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1721 microversion: 2.20 time: 0.160983 Oct 29 01:32:07.715784 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 269/527] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:32:07 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:32:08.303430 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-9cf56c0d-0bde-4d5b-ba9c-e7fe240164ff tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:08.304352 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-9cf56c0d-0bde-4d5b-ba9c-e7fe240164ff tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:08.310520 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-9cf56c0d-0bde-4d5b-ba9c-e7fe240164ff tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:08.311067 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-9cf56c0d-0bde-4d5b-ba9c-e7fe240164ff tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:08.312017 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-9cf56c0d-0bde-4d5b-ba9c-e7fe240164ff tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:08.312568 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-9cf56c0d-0bde-4d5b-ba9c-e7fe240164ff tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:08.438915 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-9cf56c0d-0bde-4d5b-ba9c-e7fe240164ff tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:08.448064 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-9cf56c0d-0bde-4d5b-ba9c-e7fe240164ff tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca" status: 200 len: 1566 microversion: 2.1 time: 0.149170 Oct 29 01:32:08.448654 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 259/528] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:08 2021] GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca => generated 1566 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:32:08.539484 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-bb2fd1d8-e86a-4dba-927b-b77fc4cdaaa0 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:08.540197 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-bb2fd1d8-e86a-4dba-927b-b77fc4cdaaa0 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] [instance: 93f60f90-a29b-4ae7-b9dc-ec821e4c7e10] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:08.546161 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-bb2fd1d8-e86a-4dba-927b-b77fc4cdaaa0 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:08.546694 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-bb2fd1d8-e86a-4dba-927b-b77fc4cdaaa0 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:08.547449 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-bb2fd1d8-e86a-4dba-927b-b77fc4cdaaa0 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:08.548003 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-bb2fd1d8-e86a-4dba-927b-b77fc4cdaaa0 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:08.574515 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-bb2fd1d8-e86a-4dba-927b-b77fc4cdaaa0 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] [instance: 93f60f90-a29b-4ae7-b9dc-ec821e4c7e10] Going to try to terminate instance {{(pid=116378) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 29 01:32:08.735350 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-f943ef7e-4037-4c27-8b99-c00c49c06733 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:08.735988 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-f943ef7e-4037-4c27-8b99-c00c49c06733 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:08.743366 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-f943ef7e-4037-4c27-8b99-c00c49c06733 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:08.744201 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-f943ef7e-4037-4c27-8b99-c00c49c06733 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:08.745174 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-f943ef7e-4037-4c27-8b99-c00c49c06733 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:08.745632 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-f943ef7e-4037-4c27-8b99-c00c49c06733 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:08.894702 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-f943ef7e-4037-4c27-8b99-c00c49c06733 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:08.907156 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-f943ef7e-4037-4c27-8b99-c00c49c06733 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:08.908727 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-f943ef7e-4037-4c27-8b99-c00c49c06733 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:08.909833 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-f943ef7e-4037-4c27-8b99-c00c49c06733 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1721 microversion: 2.20 time: 0.179273 Oct 29 01:32:08.914629 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 260/529] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:32:08 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1721 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:32:08.933739 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-bb2fd1d8-e86a-4dba-927b-b77fc4cdaaa0 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] 10.222.0.87 "DELETE /compute/v2.1/servers/93f60f90-a29b-4ae7-b9dc-ec821e4c7e10" status: 204 len: 0 microversion: 2.1 time: 0.398015 Oct 29 01:32:08.934492 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 270/530] 10.222.0.87 () {58 vars in 1238 bytes} [Fri Oct 29 01:32:08 2021] DELETE /compute/v2.1/servers/93f60f90-a29b-4ae7-b9dc-ec821e4c7e10 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:32:08.943322 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-430d2bd6-af71-40ce-bdb1-6c5668834a8e tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:08.944872 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-430d2bd6-af71-40ce-bdb1-6c5668834a8e tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] [instance: 93f60f90-a29b-4ae7-b9dc-ec821e4c7e10] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:08.953205 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-430d2bd6-af71-40ce-bdb1-6c5668834a8e tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:08.953855 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-430d2bd6-af71-40ce-bdb1-6c5668834a8e tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:08.954783 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-430d2bd6-af71-40ce-bdb1-6c5668834a8e tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:08.955570 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-430d2bd6-af71-40ce-bdb1-6c5668834a8e tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:09.167000 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-430d2bd6-af71-40ce-bdb1-6c5668834a8e tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ad077fd0164d3c8b4db14262186901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa66fedc6704473996d04ffbf8135e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:09.176772 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-430d2bd6-af71-40ce-bdb1-6c5668834a8e tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] 10.222.0.87 "GET /compute/v2.1/servers/93f60f90-a29b-4ae7-b9dc-ec821e4c7e10" status: 200 len: 1512 microversion: 2.1 time: 0.237679 Oct 29 01:32:09.177905 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 261/531] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:08 2021] GET /compute/v2.1/servers/93f60f90-a29b-4ae7-b9dc-ec821e4c7e10 => generated 1512 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:32:09.466394 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-d090db13-e13d-476a-8555-5faee41ebf53 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:09.468939 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-d090db13-e13d-476a-8555-5faee41ebf53 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:09.482434 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-d090db13-e13d-476a-8555-5faee41ebf53 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:09.482881 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-d090db13-e13d-476a-8555-5faee41ebf53 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:09.484041 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-d090db13-e13d-476a-8555-5faee41ebf53 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:09.484719 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-d090db13-e13d-476a-8555-5faee41ebf53 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:09.614875 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-d090db13-e13d-476a-8555-5faee41ebf53 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:09.623639 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-d090db13-e13d-476a-8555-5faee41ebf53 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca" status: 200 len: 1566 microversion: 2.1 time: 0.161675 Oct 29 01:32:09.624278 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 271/532] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:09 2021] GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca => generated 1566 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:32:09.928802 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-ad14071c-bd90-42a8-b00f-545de053da7c tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:09.929404 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-ad14071c-bd90-42a8-b00f-545de053da7c tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:09.935768 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-ad14071c-bd90-42a8-b00f-545de053da7c tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:09.936213 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-ad14071c-bd90-42a8-b00f-545de053da7c tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:09.936982 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-ad14071c-bd90-42a8-b00f-545de053da7c tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:09.937418 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-ad14071c-bd90-42a8-b00f-545de053da7c tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:10.065484 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-ad14071c-bd90-42a8-b00f-545de053da7c tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:10.073764 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-ad14071c-bd90-42a8-b00f-545de053da7c tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:10.075236 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-ad14071c-bd90-42a8-b00f-545de053da7c tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:10.076653 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-ad14071c-bd90-42a8-b00f-545de053da7c tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1724 microversion: 2.20 time: 0.151766 Oct 29 01:32:10.077206 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 262/533] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:32:09 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:32:10.097241 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-19fd5933-18e0-491f-965c-7b924625a8a2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9f5e6ac9-2ee2-42c3-ab4c-9b94965d1dab"}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:32:10.098448 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-19fd5933-18e0-491f-965c-7b924625a8a2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:10.105546 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-19fd5933-18e0-491f-965c-7b924625a8a2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:10.105982 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-19fd5933-18e0-491f-965c-7b924625a8a2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:10.106735 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-19fd5933-18e0-491f-965c-7b924625a8a2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:10.107158 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-19fd5933-18e0-491f-965c-7b924625a8a2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:10.197753 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-3df6a91f-1176-4fac-a496-45b64ec5f938 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:10.198373 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-3df6a91f-1176-4fac-a496-45b64ec5f938 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] [instance: 93f60f90-a29b-4ae7-b9dc-ec821e4c7e10] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:10.204796 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-3df6a91f-1176-4fac-a496-45b64ec5f938 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:10.205397 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-3df6a91f-1176-4fac-a496-45b64ec5f938 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:10.206154 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-3df6a91f-1176-4fac-a496-45b64ec5f938 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:10.206579 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-3df6a91f-1176-4fac-a496-45b64ec5f938 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:10.667425 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-3df6a91f-1176-4fac-a496-45b64ec5f938 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ad077fd0164d3c8b4db14262186901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa66fedc6704473996d04ffbf8135e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:10.674794 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-3df6a91f-1176-4fac-a496-45b64ec5f938 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] 10.222.0.87 "GET /compute/v2.1/servers/93f60f90-a29b-4ae7-b9dc-ec821e4c7e10" status: 200 len: 1512 microversion: 2.1 time: 0.482110 Oct 29 01:32:10.675505 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 263/534] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:10 2021] GET /compute/v2.1/servers/93f60f90-a29b-4ae7-b9dc-ec821e4c7e10 => generated 1512 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:32:10.687256 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-1835f53d-fa58-4d72-8193-dc238dcee771 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:10.688003 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-1835f53d-fa58-4d72-8193-dc238dcee771 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:10.696568 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-1835f53d-fa58-4d72-8193-dc238dcee771 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:10.697242 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-1835f53d-fa58-4d72-8193-dc238dcee771 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:10.698099 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-1835f53d-fa58-4d72-8193-dc238dcee771 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:10.698896 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-1835f53d-fa58-4d72-8193-dc238dcee771 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:10.921262 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-1835f53d-fa58-4d72-8193-dc238dcee771 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:10.929497 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-1835f53d-fa58-4d72-8193-dc238dcee771 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca" status: 200 len: 1566 microversion: 2.1 time: 0.252803 Oct 29 01:32:10.930177 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 264/535] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:10 2021] GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca => generated 1566 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:32:11.432087 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [req-833775b2-be99-4365-97de-5923d7c01e82 req-a8bb5f38-9861-48d1-9bee-c47fbf433d47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f64f5ebf-8af1-4507-849e-b7d8e33979ae", "name": "network-vif-unplugged", "status": "completed", "tag": "01153800-bf44-4376-854e-aec24743a4d7"}]} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:32:11.435760 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:32:11.435760 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: warnings.warn(msg) Oct 29 01:32:11.449248 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [req-833775b2-be99-4365-97de-5923d7c01e82 req-a8bb5f38-9861-48d1-9bee-c47fbf433d47 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:11.450639 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [req-833775b2-be99-4365-97de-5923d7c01e82 req-a8bb5f38-9861-48d1-9bee-c47fbf433d47 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:11.462737 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.compute.server_external_events [req-833775b2-be99-4365-97de-5923d7c01e82 req-a8bb5f38-9861-48d1-9bee-c47fbf433d47 service nova] Unable to find a host for instance f64f5ebf-8af1-4507-849e-b7d8e33979ae. Dropping event network-vif-unplugged {{(pid=116379) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Oct 29 01:32:11.473256 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [req-833775b2-be99-4365-97de-5923d7c01e82 req-a8bb5f38-9861-48d1-9bee-c47fbf433d47 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.060200 Oct 29 01:32:11.475086 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 265/536] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Oct 29 01:32:11 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 64 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 29 01:32:11.692404 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-5ba725e3-438d-4488-b28e-45f51d168b82 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:11.693193 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-5ba725e3-438d-4488-b28e-45f51d168b82 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] [instance: 93f60f90-a29b-4ae7-b9dc-ec821e4c7e10] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:11.701786 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-5ba725e3-438d-4488-b28e-45f51d168b82 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:11.702346 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-5ba725e3-438d-4488-b28e-45f51d168b82 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:11.703344 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-5ba725e3-438d-4488-b28e-45f51d168b82 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:11.704091 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-5ba725e3-438d-4488-b28e-45f51d168b82 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:11.872696 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-19fd5933-18e0-491f-965c-7b924625a8a2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.779280 Oct 29 01:32:11.873948 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 272/537] 10.222.0.87 () {62 vars in 1363 bytes} [Fri Oct 29 01:32:10 2021] POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/os-volume_attachments => generated 188 bytes in 1781 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:32:11.884825 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-5ba725e3-438d-4488-b28e-45f51d168b82 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ad077fd0164d3c8b4db14262186901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa66fedc6704473996d04ffbf8135e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:11.891574 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-5ba725e3-438d-4488-b28e-45f51d168b82 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] 10.222.0.87 "GET /compute/v2.1/servers/93f60f90-a29b-4ae7-b9dc-ec821e4c7e10" status: 200 len: 1512 microversion: 2.1 time: 0.203186 Oct 29 01:32:11.902599 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 266/538] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:11 2021] GET /compute/v2.1/servers/93f60f90-a29b-4ae7-b9dc-ec821e4c7e10 => generated 1512 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:32:11.951765 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-5f0a2c1d-c58d-43e1-8e93-50a772d60d05 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:11.952609 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-5f0a2c1d-c58d-43e1-8e93-50a772d60d05 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:11.965864 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-5f0a2c1d-c58d-43e1-8e93-50a772d60d05 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:11.972606 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-5f0a2c1d-c58d-43e1-8e93-50a772d60d05 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:11.973429 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-5f0a2c1d-c58d-43e1-8e93-50a772d60d05 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:11.973861 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-5f0a2c1d-c58d-43e1-8e93-50a772d60d05 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:12.086091 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-6bbf6d18-eb0d-403a-9d02-347aa13a3c97 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:32:12.091046 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-6bbf6d18-eb0d-403a-9d02-347aa13a3c97 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:12.103248 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-6bbf6d18-eb0d-403a-9d02-347aa13a3c97 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:12.104695 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-6bbf6d18-eb0d-403a-9d02-347aa13a3c97 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:12.106162 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-6bbf6d18-eb0d-403a-9d02-347aa13a3c97 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:12.111132 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-6bbf6d18-eb0d-403a-9d02-347aa13a3c97 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:12.191335 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-5f0a2c1d-c58d-43e1-8e93-50a772d60d05 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:12.202679 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-5f0a2c1d-c58d-43e1-8e93-50a772d60d05 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca" status: 200 len: 1566 microversion: 2.1 time: 0.259090 Oct 29 01:32:12.203766 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 273/539] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:11 2021] GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca => generated 1566 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:32:12.210248 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [req-119adcf2-9f11-4c45-bed0-0dbc3c7fac6b req-bb678763-b833-4915-a9cc-e37072551d33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93f60f90-a29b-4ae7-b9dc-ec821e4c7e10", "name": "network-vif-deleted", "tag": "bae2e6bb-454a-4acd-acb0-022f69f3a6e8"}]} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:32:12.212848 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:32:12.212848 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: warnings.warn(msg) Oct 29 01:32:12.221359 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [req-119adcf2-9f11-4c45-bed0-0dbc3c7fac6b req-bb678763-b833-4915-a9cc-e37072551d33 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:12.221807 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [req-119adcf2-9f11-4c45-bed0-0dbc3c7fac6b req-bb678763-b833-4915-a9cc-e37072551d33 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:12.233765 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.compute.server_external_events [req-119adcf2-9f11-4c45-bed0-0dbc3c7fac6b req-bb678763-b833-4915-a9cc-e37072551d33 service nova] Creating event network-vif-deleted:bae2e6bb-454a-4acd-acb0-022f69f3a6e8 for instance 93f60f90-a29b-4ae7-b9dc-ec821e4c7e10 on hv-cinder-81398 Oct 29 01:32:12.238896 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [req-119adcf2-9f11-4c45-bed0-0dbc3c7fac6b req-bb678763-b833-4915-a9cc-e37072551d33 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033839 Oct 29 01:32:12.239535 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 274/540] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Oct 29 01:32:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:32:12.462522 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-6bbf6d18-eb0d-403a-9d02-347aa13a3c97 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action" status: 202 len: 0 microversion: 2.20 time: 0.384837 Oct 29 01:32:12.463206 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 267/541] 10.222.0.87 () {62 vars in 1318 bytes} [Fri Oct 29 01:32:12 2021] POST /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/action => generated 0 bytes in 387 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:32:12.471807 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-7f2dc048-c964-4799-9405-922d47ac7951 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:12.472646 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-7f2dc048-c964-4799-9405-922d47ac7951 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:12.479939 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-7f2dc048-c964-4799-9405-922d47ac7951 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:12.480376 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-7f2dc048-c964-4799-9405-922d47ac7951 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:12.481167 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-7f2dc048-c964-4799-9405-922d47ac7951 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:12.481615 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-7f2dc048-c964-4799-9405-922d47ac7951 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:12.624319 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-7f2dc048-c964-4799-9405-922d47ac7951 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:12.634100 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-7f2dc048-c964-4799-9405-922d47ac7951 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:12.635610 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-7f2dc048-c964-4799-9405-922d47ac7951 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:12.637081 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-7f2dc048-c964-4799-9405-922d47ac7951 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1750 microversion: 2.20 time: 0.169402 Oct 29 01:32:12.637642 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 275/542] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:32:12 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1750 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:32:12.918398 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-805cf49f-a58f-4905-973c-c7b0356380e7 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:12.919004 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-805cf49f-a58f-4905-973c-c7b0356380e7 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] [instance: 93f60f90-a29b-4ae7-b9dc-ec821e4c7e10] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:12.925898 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-805cf49f-a58f-4905-973c-c7b0356380e7 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:12.931302 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-805cf49f-a58f-4905-973c-c7b0356380e7 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:12.931302 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-805cf49f-a58f-4905-973c-c7b0356380e7 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:12.931302 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-805cf49f-a58f-4905-973c-c7b0356380e7 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:12.959459 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-805cf49f-a58f-4905-973c-c7b0356380e7 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:12.960333 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-805cf49f-a58f-4905-973c-c7b0356380e7 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:12.960784 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.objects.instance [None req-805cf49f-a58f-4905-973c-c7b0356380e7 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lazy-loading 'fault' on Instance uuid 93f60f90-a29b-4ae7-b9dc-ec821e4c7e10 {{(pid=116379) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 01:32:13.008671 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-805cf49f-a58f-4905-973c-c7b0356380e7 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ad077fd0164d3c8b4db14262186901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa66fedc6704473996d04ffbf8135e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:13.017334 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-805cf49f-a58f-4905-973c-c7b0356380e7 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] 10.222.0.87 "GET /compute/v2.1/servers/93f60f90-a29b-4ae7-b9dc-ec821e4c7e10" status: 200 len: 1308 microversion: 2.1 time: 0.102780 Oct 29 01:32:13.018263 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 268/543] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:12 2021] GET /compute/v2.1/servers/93f60f90-a29b-4ae7-b9dc-ec821e4c7e10 => generated 1308 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:32:13.081869 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-c164e04d-2989-44f8-9334-af821ecae50a tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-591570978", "imageRef": "3b1d5dc6-2b04-4433-9a93-1db6a740092b", "flavorRef": "452"}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:32:13.134138 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.network.neutron [None req-c164e04d-2989-44f8-9334-af821ecae50a tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] validate_networks() for None {{(pid=116378) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 29 01:32:13.220761 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-4ad8b8f7-4fa3-4127-9622-9a3fe96adb18 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:13.221370 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-4ad8b8f7-4fa3-4127-9622-9a3fe96adb18 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:13.227133 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-4ad8b8f7-4fa3-4127-9622-9a3fe96adb18 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:13.227578 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-4ad8b8f7-4fa3-4127-9622-9a3fe96adb18 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:13.228398 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-4ad8b8f7-4fa3-4127-9622-9a3fe96adb18 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:13.228833 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-4ad8b8f7-4fa3-4127-9622-9a3fe96adb18 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:13.476973 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-4ad8b8f7-4fa3-4127-9622-9a3fe96adb18 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:13.478981 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.virt.hardware [None req-c164e04d-2989-44f8-9334-af821ecae50a tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Flavor limits 0:0:0 {{(pid=116378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:32:13.479399 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.virt.hardware [None req-c164e04d-2989-44f8-9334-af821ecae50a tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Image limits 0:0:0 {{(pid=116378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:32:13.479904 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.virt.hardware [None req-c164e04d-2989-44f8-9334-af821ecae50a tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Flavor pref 0:0:0 {{(pid=116378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:32:13.480371 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.virt.hardware [None req-c164e04d-2989-44f8-9334-af821ecae50a tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Image pref 0:0:0 {{(pid=116378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:32:13.480763 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.virt.hardware [None req-c164e04d-2989-44f8-9334-af821ecae50a tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:32:13.487551 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-4ad8b8f7-4fa3-4127-9622-9a3fe96adb18 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca" status: 200 len: 1546 microversion: 2.1 time: 0.270452 Oct 29 01:32:13.488157 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 269/544] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:13 2021] GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca => generated 1546 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:32:13.495276 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c164e04d-2989-44f8-9334-af821ecae50a tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:13.495276 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c164e04d-2989-44f8-9334-af821ecae50a tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:13.495276 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c164e04d-2989-44f8-9334-af821ecae50a tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:13.495276 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c164e04d-2989-44f8-9334-af821ecae50a tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:13.511009 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-865186e2-e92a-4598-a75a-0f7d4a563083 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:13.511983 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-865186e2-e92a-4598-a75a-0f7d4a563083 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:13.515758 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.quota [None req-c164e04d-2989-44f8-9334-af821ecae50a tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Getting quotas for project 18626e87dcd742bca0e65ddb87d7b10b. Resources: {'instances', 'cores', 'ram'} {{(pid=116378) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 01:32:13.517980 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-865186e2-e92a-4598-a75a-0f7d4a563083 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:13.518434 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-865186e2-e92a-4598-a75a-0f7d4a563083 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:13.519396 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-865186e2-e92a-4598-a75a-0f7d4a563083 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:13.519864 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-865186e2-e92a-4598-a75a-0f7d4a563083 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:13.520193 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.quota [None req-c164e04d-2989-44f8-9334-af821ecae50a tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Getting quotas for user cd18483ef44e4f83909d856b2ec64366 and project 18626e87dcd742bca0e65ddb87d7b10b. Resources: {'instances', 'cores', 'ram'} {{(pid=116378) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 01:32:13.538767 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-c164e04d-2989-44f8-9334-af821ecae50a tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Going to run 1 instances... {{(pid=116378) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 29 01:32:13.541814 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-c164e04d-2989-44f8-9334-af821ecae50a tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] [instance: 1cf67257-a3ee-4cb2-bd74-d382b9d6e903] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3b1d5dc6-2b04-4433-9a93-1db6a740092b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116378) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 29 01:32:13.606745 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.wsgi [None req-865186e2-e92a-4598-a75a-0f7d4a563083 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] HTTP exception thrown: Cannot 'detach_volume' instance 09875e40-e63d-4175-9361-fd9439c0c7ca while it is in vm_state rescued Oct 29 01:32:13.607448 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-865186e2-e92a-4598-a75a-0f7d4a563083 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Returning 409 to user: Cannot 'detach_volume' instance 09875e40-e63d-4175-9361-fd9439c0c7ca while it is in vm_state rescued {{(pid=116379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:32:13.608382 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-865186e2-e92a-4598-a75a-0f7d4a563083 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "DELETE /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca/os-volume_attachments/fb918fd7-72dd-4250-8fc5-fa49f55fd7bd" status: 409 len: 152 microversion: 2.1 time: 0.102845 Oct 29 01:32:13.609022 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 270/545] 10.222.0.87 () {58 vars in 1415 bytes} [Fri Oct 29 01:32:13 2021] DELETE /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca/os-volume_attachments/fb918fd7-72dd-4250-8fc5-fa49f55fd7bd => generated 152 bytes in 109 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 29 01:32:13.618467 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-982ca385-e821-47d5-abdc-c77a43911ede tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:32:13.619072 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-982ca385-e821-47d5-abdc-c77a43911ede tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:13.625864 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-982ca385-e821-47d5-abdc-c77a43911ede tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:13.626244 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-982ca385-e821-47d5-abdc-c77a43911ede tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:13.627171 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-982ca385-e821-47d5-abdc-c77a43911ede tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:13.627472 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-982ca385-e821-47d5-abdc-c77a43911ede tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:13.723552 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-c164e04d-2989-44f8-9334-af821ecae50a tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.645310 Oct 29 01:32:13.724375 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 276/546] 10.222.0.87 () {60 vars in 1146 bytes} [Fri Oct 29 01:32:13 2021] POST /compute/v2.1/servers => generated 380 bytes in 647 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:32:13.728762 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-4bda9daa-0fc0-47d3-8439-664c93557b8f tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:13.729647 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-4bda9daa-0fc0-47d3-8439-664c93557b8f tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:13.736048 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4bda9daa-0fc0-47d3-8439-664c93557b8f tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:13.736501 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4bda9daa-0fc0-47d3-8439-664c93557b8f tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:13.737324 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4bda9daa-0fc0-47d3-8439-664c93557b8f tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:13.737751 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4bda9daa-0fc0-47d3-8439-664c93557b8f tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:13.910462 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-4bda9daa-0fc0-47d3-8439-664c93557b8f tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:13.921832 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-4bda9daa-0fc0-47d3-8439-664c93557b8f tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:13.930956 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-4bda9daa-0fc0-47d3-8439-664c93557b8f tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:13.932197 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-4bda9daa-0fc0-47d3-8439-664c93557b8f tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1750 microversion: 2.20 time: 0.206868 Oct 29 01:32:13.940099 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 277/547] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:32:13 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1750 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:32:13.940099 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-25788c14-6dc1-4d97-9236-06b92dc8c80d tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:13.940099 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-25788c14-6dc1-4d97-9236-06b92dc8c80d tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] [instance: 1cf67257-a3ee-4cb2-bd74-d382b9d6e903] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:13.973474 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-982ca385-e821-47d5-abdc-c77a43911ede tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "POST /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca/action" status: 202 len: 0 microversion: 2.1 time: 0.359541 Oct 29 01:32:13.976113 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 271/548] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:32:13 2021] POST /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca/action => generated 0 bytes in 361 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 01:32:13.983266 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-0cba0fd2-971c-44ae-9f7b-bc7427c4a6a5 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:13.983992 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-0cba0fd2-971c-44ae-9f7b-bc7427c4a6a5 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:13.991764 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-0cba0fd2-971c-44ae-9f7b-bc7427c4a6a5 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:13.992105 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-0cba0fd2-971c-44ae-9f7b-bc7427c4a6a5 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:13.993158 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-0cba0fd2-971c-44ae-9f7b-bc7427c4a6a5 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:13.993598 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-0cba0fd2-971c-44ae-9f7b-bc7427c4a6a5 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:13.998829 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-25788c14-6dc1-4d97-9236-06b92dc8c80d tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd18483ef44e4f83909d856b2ec64366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18626e87dcd742bca0e65ddb87d7b10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:14.006072 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-25788c14-6dc1-4d97-9236-06b92dc8c80d tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] 10.222.0.87 "GET /compute/v2.1/servers/1cf67257-a3ee-4cb2-bd74-d382b9d6e903" status: 200 len: 1214 microversion: 2.1 time: 0.072323 Oct 29 01:32:14.007224 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 278/549] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:13 2021] GET /compute/v2.1/servers/1cf67257-a3ee-4cb2-bd74-d382b9d6e903 => generated 1214 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:32:14.035037 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-69b3b8d4-32f6-4174-9199-25cf1fda0586 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:14.035713 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-69b3b8d4-32f6-4174-9199-25cf1fda0586 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] [instance: 93f60f90-a29b-4ae7-b9dc-ec821e4c7e10] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:14.042806 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-69b3b8d4-32f6-4174-9199-25cf1fda0586 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:14.043322 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-69b3b8d4-32f6-4174-9199-25cf1fda0586 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:14.044206 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-69b3b8d4-32f6-4174-9199-25cf1fda0586 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:14.044697 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-69b3b8d4-32f6-4174-9199-25cf1fda0586 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:14.077971 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-69b3b8d4-32f6-4174-9199-25cf1fda0586 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:14.078407 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-69b3b8d4-32f6-4174-9199-25cf1fda0586 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:14.078844 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.objects.instance [None req-69b3b8d4-32f6-4174-9199-25cf1fda0586 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lazy-loading 'fault' on Instance uuid 93f60f90-a29b-4ae7-b9dc-ec821e4c7e10 {{(pid=116378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 01:32:14.133048 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-69b3b8d4-32f6-4174-9199-25cf1fda0586 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ad077fd0164d3c8b4db14262186901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa66fedc6704473996d04ffbf8135e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:14.139767 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-69b3b8d4-32f6-4174-9199-25cf1fda0586 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] 10.222.0.87 "GET /compute/v2.1/servers/93f60f90-a29b-4ae7-b9dc-ec821e4c7e10" status: 200 len: 1308 microversion: 2.1 time: 0.108576 Oct 29 01:32:14.140315 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 279/550] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:14 2021] GET /compute/v2.1/servers/93f60f90-a29b-4ae7-b9dc-ec821e4c7e10 => generated 1308 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:32:14.151005 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-0cba0fd2-971c-44ae-9f7b-bc7427c4a6a5 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:14.158695 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-0cba0fd2-971c-44ae-9f7b-bc7427c4a6a5 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca" status: 200 len: 1554 microversion: 2.1 time: 0.179435 Oct 29 01:32:14.159245 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 272/551] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:13 2021] GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca => generated 1554 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:32:14.952572 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-11deec1a-5f67-403d-8f10-880df968bbd4 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:14.953196 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-11deec1a-5f67-403d-8f10-880df968bbd4 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:14.959555 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-11deec1a-5f67-403d-8f10-880df968bbd4 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:14.960033 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-11deec1a-5f67-403d-8f10-880df968bbd4 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:14.960792 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-11deec1a-5f67-403d-8f10-880df968bbd4 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:14.961487 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-11deec1a-5f67-403d-8f10-880df968bbd4 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:15.024597 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-726df8d5-6710-4fca-87de-7fc782b5e4cb tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:15.025330 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-726df8d5-6710-4fca-87de-7fc782b5e4cb tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] [instance: 1cf67257-a3ee-4cb2-bd74-d382b9d6e903] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:15.096158 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-726df8d5-6710-4fca-87de-7fc782b5e4cb tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd18483ef44e4f83909d856b2ec64366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18626e87dcd742bca0e65ddb87d7b10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:15.105611 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-726df8d5-6710-4fca-87de-7fc782b5e4cb tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] 10.222.0.87 "GET /compute/v2.1/servers/1cf67257-a3ee-4cb2-bd74-d382b9d6e903" status: 200 len: 1214 microversion: 2.1 time: 0.085663 Oct 29 01:32:15.115101 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 273/552] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:15 2021] GET /compute/v2.1/servers/1cf67257-a3ee-4cb2-bd74-d382b9d6e903 => generated 1214 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:32:15.115403 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-11deec1a-5f67-403d-8f10-880df968bbd4 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:15.124421 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-11deec1a-5f67-403d-8f10-880df968bbd4 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:15.126048 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-11deec1a-5f67-403d-8f10-880df968bbd4 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:15.127208 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-11deec1a-5f67-403d-8f10-880df968bbd4 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1752 microversion: 2.20 time: 0.178543 Oct 29 01:32:15.128033 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 280/553] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:32:14 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1752 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:32:15.156950 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-c6c0d0ea-8978-41e1-b5fc-eef7ec1b2d99 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:15.157642 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-c6c0d0ea-8978-41e1-b5fc-eef7ec1b2d99 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] [instance: 93f60f90-a29b-4ae7-b9dc-ec821e4c7e10] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:15.164945 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-c6c0d0ea-8978-41e1-b5fc-eef7ec1b2d99 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:15.165412 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-c6c0d0ea-8978-41e1-b5fc-eef7ec1b2d99 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:15.166220 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-c6c0d0ea-8978-41e1-b5fc-eef7ec1b2d99 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:15.166733 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-c6c0d0ea-8978-41e1-b5fc-eef7ec1b2d99 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:15.178886 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-8ea92582-0f7e-494e-b035-f034486bda66 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:15.179684 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-8ea92582-0f7e-494e-b035-f034486bda66 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:15.182233 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.wsgi [None req-c6c0d0ea-8978-41e1-b5fc-eef7ec1b2d99 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] HTTP exception thrown: Instance 93f60f90-a29b-4ae7-b9dc-ec821e4c7e10 could not be found. Oct 29 01:32:15.182781 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-c6c0d0ea-8978-41e1-b5fc-eef7ec1b2d99 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Returning 404 to user: Instance 93f60f90-a29b-4ae7-b9dc-ec821e4c7e10 could not be found. {{(pid=116379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:32:15.183640 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-c6c0d0ea-8978-41e1-b5fc-eef7ec1b2d99 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] 10.222.0.87 "GET /compute/v2.1/servers/93f60f90-a29b-4ae7-b9dc-ec821e4c7e10" status: 404 len: 111 microversion: 2.1 time: 0.031042 Oct 29 01:32:15.184227 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 274/554] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:15 2021] GET /compute/v2.1/servers/93f60f90-a29b-4ae7-b9dc-ec821e4c7e10 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:32:15.185981 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-8ea92582-0f7e-494e-b035-f034486bda66 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:15.186435 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-8ea92582-0f7e-494e-b035-f034486bda66 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:15.187270 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-8ea92582-0f7e-494e-b035-f034486bda66 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:15.187632 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-8ea92582-0f7e-494e-b035-f034486bda66 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:15.332604 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-8ea92582-0f7e-494e-b035-f034486bda66 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:15.341810 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-8ea92582-0f7e-494e-b035-f034486bda66 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca" status: 200 len: 1554 microversion: 2.1 time: 0.167146 Oct 29 01:32:15.342379 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 281/555] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:15 2021] GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca => generated 1554 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:32:16.122442 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-5d3231f1-cf53-4400-a75f-2d7c7dc93e4e tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:16.122999 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-5d3231f1-cf53-4400-a75f-2d7c7dc93e4e tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] [instance: 1cf67257-a3ee-4cb2-bd74-d382b9d6e903] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:16.132173 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-5d3231f1-cf53-4400-a75f-2d7c7dc93e4e tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:16.132173 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-5d3231f1-cf53-4400-a75f-2d7c7dc93e4e tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:16.132173 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-5d3231f1-cf53-4400-a75f-2d7c7dc93e4e tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:16.132521 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-5d3231f1-cf53-4400-a75f-2d7c7dc93e4e tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:16.149958 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-91ddb7d3-3914-4e2d-9323-720090c4216b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:16.150691 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-91ddb7d3-3914-4e2d-9323-720090c4216b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:16.158385 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-91ddb7d3-3914-4e2d-9323-720090c4216b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:16.158833 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-91ddb7d3-3914-4e2d-9323-720090c4216b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:16.159911 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-91ddb7d3-3914-4e2d-9323-720090c4216b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:16.164035 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-91ddb7d3-3914-4e2d-9323-720090c4216b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:16.197027 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-5d3231f1-cf53-4400-a75f-2d7c7dc93e4e tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd18483ef44e4f83909d856b2ec64366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18626e87dcd742bca0e65ddb87d7b10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:16.205156 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-5d3231f1-cf53-4400-a75f-2d7c7dc93e4e tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] 10.222.0.87 "GET /compute/v2.1/servers/1cf67257-a3ee-4cb2-bd74-d382b9d6e903" status: 200 len: 1266 microversion: 2.1 time: 0.086645 Oct 29 01:32:16.205778 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 275/556] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:16 2021] GET /compute/v2.1/servers/1cf67257-a3ee-4cb2-bd74-d382b9d6e903 => generated 1266 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:32:16.294984 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-91ddb7d3-3914-4e2d-9323-720090c4216b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:16.304459 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-91ddb7d3-3914-4e2d-9323-720090c4216b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:16.305969 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-91ddb7d3-3914-4e2d-9323-720090c4216b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:16.307156 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-91ddb7d3-3914-4e2d-9323-720090c4216b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1752 microversion: 2.20 time: 0.161603 Oct 29 01:32:16.307716 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 282/557] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:32:16 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1752 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:32:16.360011 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-1c3080c3-9866-4a9d-a86d-6f7ec3a4d43d tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:16.360615 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-1c3080c3-9866-4a9d-a86d-6f7ec3a4d43d tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:16.366499 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-1c3080c3-9866-4a9d-a86d-6f7ec3a4d43d tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:16.366940 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-1c3080c3-9866-4a9d-a86d-6f7ec3a4d43d tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:16.372585 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-1c3080c3-9866-4a9d-a86d-6f7ec3a4d43d tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:16.372585 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-1c3080c3-9866-4a9d-a86d-6f7ec3a4d43d tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:16.491170 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-1c3080c3-9866-4a9d-a86d-6f7ec3a4d43d tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:16.498795 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-1c3080c3-9866-4a9d-a86d-6f7ec3a4d43d tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca" status: 200 len: 1554 microversion: 2.1 time: 0.142463 Oct 29 01:32:16.499359 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 276/558] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:16 2021] GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca => generated 1554 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:32:17.223824 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-3e7098c8-30fb-4ed3-a682-e3be360944d5 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:17.224368 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-3e7098c8-30fb-4ed3-a682-e3be360944d5 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] [instance: 1cf67257-a3ee-4cb2-bd74-d382b9d6e903] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:17.231456 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-3e7098c8-30fb-4ed3-a682-e3be360944d5 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:17.237057 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-3e7098c8-30fb-4ed3-a682-e3be360944d5 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:17.237057 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-3e7098c8-30fb-4ed3-a682-e3be360944d5 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:17.237057 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-3e7098c8-30fb-4ed3-a682-e3be360944d5 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:17.297264 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-3e7098c8-30fb-4ed3-a682-e3be360944d5 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd18483ef44e4f83909d856b2ec64366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18626e87dcd742bca0e65ddb87d7b10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:17.305910 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-3e7098c8-30fb-4ed3-a682-e3be360944d5 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] 10.222.0.87 "GET /compute/v2.1/servers/1cf67257-a3ee-4cb2-bd74-d382b9d6e903" status: 200 len: 1266 microversion: 2.1 time: 0.085788 Oct 29 01:32:17.306493 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 283/559] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:17 2021] GET /compute/v2.1/servers/1cf67257-a3ee-4cb2-bd74-d382b9d6e903 => generated 1266 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:32:17.324957 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-7d0c23c4-946a-48a8-ad4e-c982c9d73a88 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:17.325580 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-7d0c23c4-946a-48a8-ad4e-c982c9d73a88 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:17.332068 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-7d0c23c4-946a-48a8-ad4e-c982c9d73a88 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:17.332517 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-7d0c23c4-946a-48a8-ad4e-c982c9d73a88 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:17.333282 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-7d0c23c4-946a-48a8-ad4e-c982c9d73a88 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:17.333715 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-7d0c23c4-946a-48a8-ad4e-c982c9d73a88 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:17.455150 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-7d0c23c4-946a-48a8-ad4e-c982c9d73a88 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:17.463925 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-7d0c23c4-946a-48a8-ad4e-c982c9d73a88 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:17.465453 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-7d0c23c4-946a-48a8-ad4e-c982c9d73a88 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:17.466597 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-7d0c23c4-946a-48a8-ad4e-c982c9d73a88 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1752 microversion: 2.20 time: 0.145287 Oct 29 01:32:17.467142 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 277/560] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:32:17 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1752 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:32:17.516023 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-827145ae-8ce3-4a38-89a3-6df7f0f7824f tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:17.516557 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-827145ae-8ce3-4a38-89a3-6df7f0f7824f tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:17.523687 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-827145ae-8ce3-4a38-89a3-6df7f0f7824f tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:17.524150 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-827145ae-8ce3-4a38-89a3-6df7f0f7824f tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:17.524950 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-827145ae-8ce3-4a38-89a3-6df7f0f7824f tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:17.525423 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-827145ae-8ce3-4a38-89a3-6df7f0f7824f tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:17.647197 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-827145ae-8ce3-4a38-89a3-6df7f0f7824f tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:17.654986 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-827145ae-8ce3-4a38-89a3-6df7f0f7824f tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca" status: 200 len: 1554 microversion: 2.1 time: 0.142761 Oct 29 01:32:17.655542 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 284/561] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:17 2021] GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca => generated 1554 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:32:18.322279 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-5c1c8da8-a8ec-4eb8-a1ae-a9ca9bac1674 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:18.322876 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-5c1c8da8-a8ec-4eb8-a1ae-a9ca9bac1674 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] [instance: 1cf67257-a3ee-4cb2-bd74-d382b9d6e903] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:18.329563 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-5c1c8da8-a8ec-4eb8-a1ae-a9ca9bac1674 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:18.330235 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-5c1c8da8-a8ec-4eb8-a1ae-a9ca9bac1674 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:18.330743 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-5c1c8da8-a8ec-4eb8-a1ae-a9ca9bac1674 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:18.331256 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-5c1c8da8-a8ec-4eb8-a1ae-a9ca9bac1674 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:18.394193 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-5c1c8da8-a8ec-4eb8-a1ae-a9ca9bac1674 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd18483ef44e4f83909d856b2ec64366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18626e87dcd742bca0e65ddb87d7b10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:18.402000 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-5c1c8da8-a8ec-4eb8-a1ae-a9ca9bac1674 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] 10.222.0.87 "GET /compute/v2.1/servers/1cf67257-a3ee-4cb2-bd74-d382b9d6e903" status: 200 len: 1266 microversion: 2.1 time: 0.083527 Oct 29 01:32:18.402622 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 278/562] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:18 2021] GET /compute/v2.1/servers/1cf67257-a3ee-4cb2-bd74-d382b9d6e903 => generated 1266 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:32:18.485577 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-3f7e280e-a0d7-4286-8576-168e35e7b888 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:18.486338 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-3f7e280e-a0d7-4286-8576-168e35e7b888 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:18.492683 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-3f7e280e-a0d7-4286-8576-168e35e7b888 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:18.493120 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-3f7e280e-a0d7-4286-8576-168e35e7b888 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:18.493882 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-3f7e280e-a0d7-4286-8576-168e35e7b888 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:18.494314 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-3f7e280e-a0d7-4286-8576-168e35e7b888 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:18.619399 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-3f7e280e-a0d7-4286-8576-168e35e7b888 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:18.627715 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-3f7e280e-a0d7-4286-8576-168e35e7b888 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:18.629233 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-3f7e280e-a0d7-4286-8576-168e35e7b888 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:18.630696 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-3f7e280e-a0d7-4286-8576-168e35e7b888 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1752 microversion: 2.20 time: 0.148868 Oct 29 01:32:18.631858 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 285/563] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:32:18 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1752 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:32:18.673761 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-3e8ca911-c799-4d9f-b2e3-b9539bd79f85 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:18.674370 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-3e8ca911-c799-4d9f-b2e3-b9539bd79f85 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:18.680352 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-3e8ca911-c799-4d9f-b2e3-b9539bd79f85 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:18.680797 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-3e8ca911-c799-4d9f-b2e3-b9539bd79f85 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:18.681568 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-3e8ca911-c799-4d9f-b2e3-b9539bd79f85 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:18.682000 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-3e8ca911-c799-4d9f-b2e3-b9539bd79f85 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:18.806286 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-3e8ca911-c799-4d9f-b2e3-b9539bd79f85 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:18.814083 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-3e8ca911-c799-4d9f-b2e3-b9539bd79f85 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca" status: 200 len: 1554 microversion: 2.1 time: 0.145043 Oct 29 01:32:18.814640 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 279/564] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:18 2021] GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca => generated 1554 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:32:19.420221 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-4aa36355-5d6c-4b5b-a6bd-cc91ac5372bb tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:19.421184 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-4aa36355-5d6c-4b5b-a6bd-cc91ac5372bb tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] [instance: 1cf67257-a3ee-4cb2-bd74-d382b9d6e903] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:19.427973 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4aa36355-5d6c-4b5b-a6bd-cc91ac5372bb tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:19.429527 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4aa36355-5d6c-4b5b-a6bd-cc91ac5372bb tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:19.430540 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4aa36355-5d6c-4b5b-a6bd-cc91ac5372bb tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:19.431261 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4aa36355-5d6c-4b5b-a6bd-cc91ac5372bb tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:19.496364 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-4aa36355-5d6c-4b5b-a6bd-cc91ac5372bb tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd18483ef44e4f83909d856b2ec64366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18626e87dcd742bca0e65ddb87d7b10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:19.505400 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-4aa36355-5d6c-4b5b-a6bd-cc91ac5372bb tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] 10.222.0.87 "GET /compute/v2.1/servers/1cf67257-a3ee-4cb2-bd74-d382b9d6e903" status: 200 len: 1266 microversion: 2.1 time: 0.089237 Oct 29 01:32:19.505974 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 286/565] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:19 2021] GET /compute/v2.1/servers/1cf67257-a3ee-4cb2-bd74-d382b9d6e903 => generated 1266 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:32:19.650606 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-42ed0ff3-f682-4416-a3c7-70a7193ca8d5 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:19.651378 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-42ed0ff3-f682-4416-a3c7-70a7193ca8d5 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:19.659278 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-42ed0ff3-f682-4416-a3c7-70a7193ca8d5 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:19.660109 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-42ed0ff3-f682-4416-a3c7-70a7193ca8d5 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:19.661015 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-42ed0ff3-f682-4416-a3c7-70a7193ca8d5 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:19.661471 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-42ed0ff3-f682-4416-a3c7-70a7193ca8d5 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:19.832679 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-abdefbee-3e45-44da-8dac-7ebeac3fef43 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:19.833838 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-abdefbee-3e45-44da-8dac-7ebeac3fef43 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:19.841430 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-abdefbee-3e45-44da-8dac-7ebeac3fef43 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:19.841887 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-abdefbee-3e45-44da-8dac-7ebeac3fef43 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:19.842675 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-abdefbee-3e45-44da-8dac-7ebeac3fef43 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:19.843092 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-abdefbee-3e45-44da-8dac-7ebeac3fef43 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:19.889089 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-42ed0ff3-f682-4416-a3c7-70a7193ca8d5 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:19.898476 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-42ed0ff3-f682-4416-a3c7-70a7193ca8d5 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:19.899985 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-42ed0ff3-f682-4416-a3c7-70a7193ca8d5 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:19.901132 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-42ed0ff3-f682-4416-a3c7-70a7193ca8d5 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1808 microversion: 2.20 time: 0.254985 Oct 29 01:32:19.901689 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 280/566] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:32:19 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1808 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:32:20.031559 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-abdefbee-3e45-44da-8dac-7ebeac3fef43 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:20.040532 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-abdefbee-3e45-44da-8dac-7ebeac3fef43 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca" status: 200 len: 1554 microversion: 2.1 time: 0.212046 Oct 29 01:32:20.041112 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 287/567] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:19 2021] GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca => generated 1554 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:32:20.524214 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-fc028f88-4c26-466c-b544-d56439f53827 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:20.524772 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-fc028f88-4c26-466c-b544-d56439f53827 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] [instance: 1cf67257-a3ee-4cb2-bd74-d382b9d6e903] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:20.530566 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-fc028f88-4c26-466c-b544-d56439f53827 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:20.531073 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-fc028f88-4c26-466c-b544-d56439f53827 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:20.531889 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-fc028f88-4c26-466c-b544-d56439f53827 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:20.532320 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-fc028f88-4c26-466c-b544-d56439f53827 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:20.617386 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-fc028f88-4c26-466c-b544-d56439f53827 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd18483ef44e4f83909d856b2ec64366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18626e87dcd742bca0e65ddb87d7b10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:20.627045 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-fc028f88-4c26-466c-b544-d56439f53827 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] 10.222.0.87 "GET /compute/v2.1/servers/1cf67257-a3ee-4cb2-bd74-d382b9d6e903" status: 200 len: 1272 microversion: 2.1 time: 0.107953 Oct 29 01:32:20.627620 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 281/568] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:20 2021] GET /compute/v2.1/servers/1cf67257-a3ee-4cb2-bd74-d382b9d6e903 => generated 1272 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:32:20.919799 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-b175d24e-2863-4436-b9ea-3be5021d9968 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:20.920429 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-b175d24e-2863-4436-b9ea-3be5021d9968 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:20.926512 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-b175d24e-2863-4436-b9ea-3be5021d9968 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:20.926955 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-b175d24e-2863-4436-b9ea-3be5021d9968 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:20.927764 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-b175d24e-2863-4436-b9ea-3be5021d9968 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:20.928241 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-b175d24e-2863-4436-b9ea-3be5021d9968 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:21.058702 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-f7a34476-6972-4b09-b319-b0f2ae879d4f tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:21.059300 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-f7a34476-6972-4b09-b319-b0f2ae879d4f tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:21.066723 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-f7a34476-6972-4b09-b319-b0f2ae879d4f tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:21.068314 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-f7a34476-6972-4b09-b319-b0f2ae879d4f tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:21.068314 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-f7a34476-6972-4b09-b319-b0f2ae879d4f tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:21.069807 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-f7a34476-6972-4b09-b319-b0f2ae879d4f tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:21.531942 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-b175d24e-2863-4436-b9ea-3be5021d9968 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:21.553755 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-b175d24e-2863-4436-b9ea-3be5021d9968 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:21.556220 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-b175d24e-2863-4436-b9ea-3be5021d9968 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:21.558653 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-b175d24e-2863-4436-b9ea-3be5021d9968 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1808 microversion: 2.20 time: 0.641777 Oct 29 01:32:21.571944 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 288/569] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:32:20 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1808 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:32:21.610380 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-f7a34476-6972-4b09-b319-b0f2ae879d4f tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:21.620568 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-f7a34476-6972-4b09-b319-b0f2ae879d4f tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca" status: 200 len: 1560 microversion: 2.1 time: 0.566182 Oct 29 01:32:21.627118 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 282/570] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:21 2021] GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca => generated 1560 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:32:21.653038 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-ece68281-feb2-48db-ae6a-b2545fb87b35 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:21.656635 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-ece68281-feb2-48db-ae6a-b2545fb87b35 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] [instance: 1cf67257-a3ee-4cb2-bd74-d382b9d6e903] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:21.659605 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ece68281-feb2-48db-ae6a-b2545fb87b35 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:21.660096 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ece68281-feb2-48db-ae6a-b2545fb87b35 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:21.661082 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ece68281-feb2-48db-ae6a-b2545fb87b35 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:21.661538 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ece68281-feb2-48db-ae6a-b2545fb87b35 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:21.700688 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-6707d0cd-891f-44ed-8479-6b9c883b7640 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:21.701503 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-6707d0cd-891f-44ed-8479-6b9c883b7640 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:21.707424 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-6707d0cd-891f-44ed-8479-6b9c883b7640 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:21.715431 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-6707d0cd-891f-44ed-8479-6b9c883b7640 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:21.715431 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-6707d0cd-891f-44ed-8479-6b9c883b7640 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:21.715431 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-6707d0cd-891f-44ed-8479-6b9c883b7640 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:21.797290 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.objects.instance [None req-6707d0cd-891f-44ed-8479-6b9c883b7640 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lazy-loading 'services' on Instance uuid 09875e40-e63d-4175-9361-fd9439c0c7ca {{(pid=116379) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 01:32:21.899143 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-ece68281-feb2-48db-ae6a-b2545fb87b35 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd18483ef44e4f83909d856b2ec64366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18626e87dcd742bca0e65ddb87d7b10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:21.906596 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-ece68281-feb2-48db-ae6a-b2545fb87b35 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] 10.222.0.87 "GET /compute/v2.1/servers/1cf67257-a3ee-4cb2-bd74-d382b9d6e903" status: 200 len: 1314 microversion: 2.1 time: 0.261284 Oct 29 01:32:21.917174 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 289/571] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:21 2021] GET /compute/v2.1/servers/1cf67257-a3ee-4cb2-bd74-d382b9d6e903 => generated 1314 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:32:22.030629 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-6707d0cd-891f-44ed-8479-6b9c883b7640 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "DELETE /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca/os-volume_attachments/fb918fd7-72dd-4250-8fc5-fa49f55fd7bd" status: 202 len: 0 microversion: 2.1 time: 0.333451 Oct 29 01:32:22.031208 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 283/572] 10.222.0.87 () {58 vars in 1415 bytes} [Fri Oct 29 01:32:21 2021] DELETE /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca/os-volume_attachments/fb918fd7-72dd-4250-8fc5-fa49f55fd7bd => generated 0 bytes in 335 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 01:32:22.044347 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-a7b0efb3-f3ca-4483-a5f0-b0ed7df5bc9c tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:22.045385 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-a7b0efb3-f3ca-4483-a5f0-b0ed7df5bc9c tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:22.053777 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a7b0efb3-f3ca-4483-a5f0-b0ed7df5bc9c tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:22.054230 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a7b0efb3-f3ca-4483-a5f0-b0ed7df5bc9c tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:22.055094 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a7b0efb3-f3ca-4483-a5f0-b0ed7df5bc9c tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:22.055531 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a7b0efb3-f3ca-4483-a5f0-b0ed7df5bc9c tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:22.115086 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-a7b0efb3-f3ca-4483-a5f0-b0ed7df5bc9c tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078085 Oct 29 01:32:22.117674 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 290/573] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Oct 29 01:32:22 2021] GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:32:22.580207 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-d393aa86-2029-43c3-b9e6-1e7d52dffc17 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:22.580889 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-d393aa86-2029-43c3-b9e6-1e7d52dffc17 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:22.610896 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d393aa86-2029-43c3-b9e6-1e7d52dffc17 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:22.611376 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d393aa86-2029-43c3-b9e6-1e7d52dffc17 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:22.612185 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d393aa86-2029-43c3-b9e6-1e7d52dffc17 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:22.612610 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d393aa86-2029-43c3-b9e6-1e7d52dffc17 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:22.724586 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [req-be952ba4-ada7-4872-9470-496d7a4d8d0d req-6fa38045-4ddb-4ba9-b7f1-89ef2ca1cf81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cf67257-a3ee-4cb2-bd74-d382b9d6e903", "tag": "df08f389-09bf-4e90-a0eb-f79791090268"}]} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:32:22.726906 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:32:22.726906 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: warnings.warn(msg) Oct 29 01:32:22.734140 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [req-be952ba4-ada7-4872-9470-496d7a4d8d0d req-6fa38045-4ddb-4ba9-b7f1-89ef2ca1cf81 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:22.734655 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [req-be952ba4-ada7-4872-9470-496d7a4d8d0d req-6fa38045-4ddb-4ba9-b7f1-89ef2ca1cf81 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:22.748441 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.compute.server_external_events [req-be952ba4-ada7-4872-9470-496d7a4d8d0d req-6fa38045-4ddb-4ba9-b7f1-89ef2ca1cf81 service nova] Creating event network-changed:df08f389-09bf-4e90-a0eb-f79791090268 for instance 1cf67257-a3ee-4cb2-bd74-d382b9d6e903 on hv-cinder-81398 Oct 29 01:32:22.753852 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [req-be952ba4-ada7-4872-9470-496d7a4d8d0d req-6fa38045-4ddb-4ba9-b7f1-89ef2ca1cf81 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034658 Oct 29 01:32:22.754444 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 291/574] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Oct 29 01:32:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:32:22.807349 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-d393aa86-2029-43c3-b9e6-1e7d52dffc17 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:22.816263 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-d393aa86-2029-43c3-b9e6-1e7d52dffc17 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:22.817800 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-d393aa86-2029-43c3-b9e6-1e7d52dffc17 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:22.820280 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-d393aa86-2029-43c3-b9e6-1e7d52dffc17 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1808 microversion: 2.20 time: 0.243848 Oct 29 01:32:22.820852 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 284/575] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:32:22 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1808 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:32:22.925851 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-87316432-fb90-4ee4-bda1-ceac95afb3c1 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:22.926583 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-87316432-fb90-4ee4-bda1-ceac95afb3c1 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] [instance: 1cf67257-a3ee-4cb2-bd74-d382b9d6e903] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:22.933380 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-87316432-fb90-4ee4-bda1-ceac95afb3c1 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:22.933829 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-87316432-fb90-4ee4-bda1-ceac95afb3c1 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:22.934592 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-87316432-fb90-4ee4-bda1-ceac95afb3c1 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:22.935025 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-87316432-fb90-4ee4-bda1-ceac95afb3c1 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:23.064143 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-87316432-fb90-4ee4-bda1-ceac95afb3c1 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd18483ef44e4f83909d856b2ec64366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18626e87dcd742bca0e65ddb87d7b10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:23.072946 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-87316432-fb90-4ee4-bda1-ceac95afb3c1 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] 10.222.0.87 "GET /compute/v2.1/servers/1cf67257-a3ee-4cb2-bd74-d382b9d6e903" status: 200 len: 1314 microversion: 2.1 time: 0.151314 Oct 29 01:32:23.073503 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 292/576] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:22 2021] GET /compute/v2.1/servers/1cf67257-a3ee-4cb2-bd74-d382b9d6e903 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:32:23.128734 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-3ccdae4f-2b31-4565-91a5-a964a7d836c5 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:23.129612 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-3ccdae4f-2b31-4565-91a5-a964a7d836c5 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:23.136031 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-3ccdae4f-2b31-4565-91a5-a964a7d836c5 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:23.136487 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-3ccdae4f-2b31-4565-91a5-a964a7d836c5 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:23.137266 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-3ccdae4f-2b31-4565-91a5-a964a7d836c5 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:23.137696 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-3ccdae4f-2b31-4565-91a5-a964a7d836c5 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:23.167193 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-3ccdae4f-2b31-4565-91a5-a964a7d836c5 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042309 Oct 29 01:32:23.167788 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 285/577] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Oct 29 01:32:23 2021] GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:32:23.839410 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-2230a0f1-be10-4773-ab84-58a36938e587 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:23.840031 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-2230a0f1-be10-4773-ab84-58a36938e587 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:23.846245 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-2230a0f1-be10-4773-ab84-58a36938e587 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:23.846689 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-2230a0f1-be10-4773-ab84-58a36938e587 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:23.847442 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-2230a0f1-be10-4773-ab84-58a36938e587 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:23.847957 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-2230a0f1-be10-4773-ab84-58a36938e587 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:23.973891 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-2230a0f1-be10-4773-ab84-58a36938e587 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:23.983107 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-2230a0f1-be10-4773-ab84-58a36938e587 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:23.984651 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-2230a0f1-be10-4773-ab84-58a36938e587 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:23.985811 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-2230a0f1-be10-4773-ab84-58a36938e587 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1808 microversion: 2.20 time: 0.150928 Oct 29 01:32:23.986404 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 293/578] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:32:23 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1808 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:32:24.090507 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-836b1e5f-03eb-4fac-abdb-08e9a9dd0353 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:24.091102 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-836b1e5f-03eb-4fac-abdb-08e9a9dd0353 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] [instance: 1cf67257-a3ee-4cb2-bd74-d382b9d6e903] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:24.097337 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-836b1e5f-03eb-4fac-abdb-08e9a9dd0353 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:24.097776 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-836b1e5f-03eb-4fac-abdb-08e9a9dd0353 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:24.098529 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-836b1e5f-03eb-4fac-abdb-08e9a9dd0353 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:24.098956 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-836b1e5f-03eb-4fac-abdb-08e9a9dd0353 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:24.178574 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-4ab1469f-e834-438f-946c-b484eee5ad78 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:24.179488 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-4ab1469f-e834-438f-946c-b484eee5ad78 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:24.185415 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4ab1469f-e834-438f-946c-b484eee5ad78 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:24.185855 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4ab1469f-e834-438f-946c-b484eee5ad78 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:24.186616 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4ab1469f-e834-438f-946c-b484eee5ad78 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:24.187045 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4ab1469f-e834-438f-946c-b484eee5ad78 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:24.217746 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-4ab1469f-e834-438f-946c-b484eee5ad78 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042977 Oct 29 01:32:24.218312 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 294/579] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Oct 29 01:32:24 2021] GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:32:24.232388 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-836b1e5f-03eb-4fac-abdb-08e9a9dd0353 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd18483ef44e4f83909d856b2ec64366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18626e87dcd742bca0e65ddb87d7b10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:24.240664 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-836b1e5f-03eb-4fac-abdb-08e9a9dd0353 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] 10.222.0.87 "GET /compute/v2.1/servers/1cf67257-a3ee-4cb2-bd74-d382b9d6e903" status: 200 len: 1314 microversion: 2.1 time: 0.153897 Oct 29 01:32:24.241426 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 286/580] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:24 2021] GET /compute/v2.1/servers/1cf67257-a3ee-4cb2-bd74-d382b9d6e903 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:32:25.004945 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-5d125554-06f1-4ec5-8251-77a84459805b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:25.005547 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-5d125554-06f1-4ec5-8251-77a84459805b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:25.016308 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-5d125554-06f1-4ec5-8251-77a84459805b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:25.016770 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-5d125554-06f1-4ec5-8251-77a84459805b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:25.017903 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-5d125554-06f1-4ec5-8251-77a84459805b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:25.018579 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-5d125554-06f1-4ec5-8251-77a84459805b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:25.163191 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-5d125554-06f1-4ec5-8251-77a84459805b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:25.171782 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-5d125554-06f1-4ec5-8251-77a84459805b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:25.173361 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-5d125554-06f1-4ec5-8251-77a84459805b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:25.174499 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-5d125554-06f1-4ec5-8251-77a84459805b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1808 microversion: 2.20 time: 0.173429 Oct 29 01:32:25.175042 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 295/581] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:32:24 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:32:25.230394 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-37777e0f-256b-44a4-b4b8-69cfcf0835b9 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:25.232077 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-37777e0f-256b-44a4-b4b8-69cfcf0835b9 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:25.238965 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-37777e0f-256b-44a4-b4b8-69cfcf0835b9 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:25.239412 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-37777e0f-256b-44a4-b4b8-69cfcf0835b9 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:25.240334 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-37777e0f-256b-44a4-b4b8-69cfcf0835b9 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:25.240763 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-37777e0f-256b-44a4-b4b8-69cfcf0835b9 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:25.257698 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-bdfe73ea-a8dc-4c87-ba8a-6800443bd5c0 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:25.258535 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-bdfe73ea-a8dc-4c87-ba8a-6800443bd5c0 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] [instance: 1cf67257-a3ee-4cb2-bd74-d382b9d6e903] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:25.265323 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-bdfe73ea-a8dc-4c87-ba8a-6800443bd5c0 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:25.265779 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-bdfe73ea-a8dc-4c87-ba8a-6800443bd5c0 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:25.266747 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-bdfe73ea-a8dc-4c87-ba8a-6800443bd5c0 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:25.267391 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-bdfe73ea-a8dc-4c87-ba8a-6800443bd5c0 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:25.282157 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-37777e0f-256b-44a4-b4b8-69cfcf0835b9 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056758 Oct 29 01:32:25.286368 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 287/582] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Oct 29 01:32:25 2021] GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:32:25.412811 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-bdfe73ea-a8dc-4c87-ba8a-6800443bd5c0 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd18483ef44e4f83909d856b2ec64366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18626e87dcd742bca0e65ddb87d7b10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:25.422535 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-bdfe73ea-a8dc-4c87-ba8a-6800443bd5c0 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] 10.222.0.87 "GET /compute/v2.1/servers/1cf67257-a3ee-4cb2-bd74-d382b9d6e903" status: 200 len: 1314 microversion: 2.1 time: 0.168524 Oct 29 01:32:25.423122 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 296/583] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:25 2021] GET /compute/v2.1/servers/1cf67257-a3ee-4cb2-bd74-d382b9d6e903 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:32:25.804180 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-6323276e-3b3a-4dd2-b7d6-a2cdefe4d8f0 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-761966381", "imageRef": "3b1d5dc6-2b04-4433-9a93-1db6a740092b", "flavorRef": "452", "networks": [{"uuid": "a043b94c-5557-4790-9d4f-a18ae31f901e"}]}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:32:25.857304 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.network.neutron [None req-6323276e-3b3a-4dd2-b7d6-a2cdefe4d8f0 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] validate_networks() for [('a043b94c-5557-4790-9d4f-a18ae31f901e', None, None, None, None, None)] {{(pid=116379) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 29 01:32:26.194222 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-52c713ab-4702-477d-9744-89c34fa53f4f tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:26.194820 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-52c713ab-4702-477d-9744-89c34fa53f4f tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:26.201453 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-52c713ab-4702-477d-9744-89c34fa53f4f tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:26.201895 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-52c713ab-4702-477d-9744-89c34fa53f4f tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:26.202657 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-52c713ab-4702-477d-9744-89c34fa53f4f tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:26.203080 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-52c713ab-4702-477d-9744-89c34fa53f4f tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:26.225378 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.virt.hardware [None req-6323276e-3b3a-4dd2-b7d6-a2cdefe4d8f0 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Flavor limits 0:0:0 {{(pid=116379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:32:26.225799 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.virt.hardware [None req-6323276e-3b3a-4dd2-b7d6-a2cdefe4d8f0 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Image limits 0:0:0 {{(pid=116379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:32:26.226298 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.virt.hardware [None req-6323276e-3b3a-4dd2-b7d6-a2cdefe4d8f0 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Flavor pref 0:0:0 {{(pid=116379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:32:26.227396 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.virt.hardware [None req-6323276e-3b3a-4dd2-b7d6-a2cdefe4d8f0 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Image pref 0:0:0 {{(pid=116379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:32:26.227842 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.virt.hardware [None req-6323276e-3b3a-4dd2-b7d6-a2cdefe4d8f0 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:32:26.238302 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-6323276e-3b3a-4dd2-b7d6-a2cdefe4d8f0 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:26.239699 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-6323276e-3b3a-4dd2-b7d6-a2cdefe4d8f0 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:26.240831 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-6323276e-3b3a-4dd2-b7d6-a2cdefe4d8f0 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:26.241544 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-6323276e-3b3a-4dd2-b7d6-a2cdefe4d8f0 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:26.275091 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.quota [None req-6323276e-3b3a-4dd2-b7d6-a2cdefe4d8f0 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Getting quotas for project 7aa66fedc6704473996d04ffbf8135e0. Resources: {'instances', 'cores', 'ram'} {{(pid=116379) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 01:32:26.289942 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.quota [None req-6323276e-3b3a-4dd2-b7d6-a2cdefe4d8f0 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Getting quotas for user 34ad077fd0164d3c8b4db14262186901 and project 7aa66fedc6704473996d04ffbf8135e0. Resources: {'instances', 'cores', 'ram'} {{(pid=116379) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 01:32:26.301785 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-6323276e-3b3a-4dd2-b7d6-a2cdefe4d8f0 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Going to run 1 instances... {{(pid=116379) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 29 01:32:26.304223 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-6323276e-3b3a-4dd2-b7d6-a2cdefe4d8f0 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] [instance: c49107f1-6a48-4184-8bb6-fa2f027193ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3b1d5dc6-2b04-4433-9a93-1db6a740092b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116379) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 29 01:32:26.342598 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-52c713ab-4702-477d-9744-89c34fa53f4f tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:26.351000 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-52c713ab-4702-477d-9744-89c34fa53f4f tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:26.353082 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-52c713ab-4702-477d-9744-89c34fa53f4f tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:26.354273 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-52c713ab-4702-477d-9744-89c34fa53f4f tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1808 microversion: 2.20 time: 0.163890 Oct 29 01:32:26.354822 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 297/584] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:32:26 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:32:26.359075 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-7588fc31-5786-46c3-8ed0-e62adc7972c3 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:26.360012 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-7588fc31-5786-46c3-8ed0-e62adc7972c3 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:26.366995 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-7588fc31-5786-46c3-8ed0-e62adc7972c3 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:26.366995 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-7588fc31-5786-46c3-8ed0-e62adc7972c3 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:26.366995 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-7588fc31-5786-46c3-8ed0-e62adc7972c3 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:26.367298 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-7588fc31-5786-46c3-8ed0-e62adc7972c3 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:26.399456 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-7588fc31-5786-46c3-8ed0-e62adc7972c3 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043071 Oct 29 01:32:26.400349 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 298/585] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Oct 29 01:32:26 2021] GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:32:26.440156 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-6323276e-3b3a-4dd2-b7d6-a2cdefe4d8f0 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.639089 Oct 29 01:32:26.441811 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-de0711bc-f867-4e29-b483-860812d70b34 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:26.441930 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 288/586] 10.222.0.87 () {60 vars in 1146 bytes} [Fri Oct 29 01:32:25 2021] POST /compute/v2.1/servers => generated 380 bytes in 641 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:32:26.442027 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-de0711bc-f867-4e29-b483-860812d70b34 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] [instance: 1cf67257-a3ee-4cb2-bd74-d382b9d6e903] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:26.448243 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-de0711bc-f867-4e29-b483-860812d70b34 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:26.448687 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-de0711bc-f867-4e29-b483-860812d70b34 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:26.449470 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-de0711bc-f867-4e29-b483-860812d70b34 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:26.449893 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-de0711bc-f867-4e29-b483-860812d70b34 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:26.455819 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-29d06e79-1018-4b31-985f-f18d5827b58d tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:26.456425 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-29d06e79-1018-4b31-985f-f18d5827b58d tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] [instance: c49107f1-6a48-4184-8bb6-fa2f027193ba] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:26.537628 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-29d06e79-1018-4b31-985f-f18d5827b58d tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ad077fd0164d3c8b4db14262186901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa66fedc6704473996d04ffbf8135e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:26.545799 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-29d06e79-1018-4b31-985f-f18d5827b58d tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] 10.222.0.87 "GET /compute/v2.1/servers/c49107f1-6a48-4184-8bb6-fa2f027193ba" status: 200 len: 1218 microversion: 2.1 time: 0.093485 Oct 29 01:32:26.546379 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 289/587] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:26 2021] GET /compute/v2.1/servers/c49107f1-6a48-4184-8bb6-fa2f027193ba => generated 1218 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:32:26.604395 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-de0711bc-f867-4e29-b483-860812d70b34 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd18483ef44e4f83909d856b2ec64366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18626e87dcd742bca0e65ddb87d7b10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:26.611545 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-de0711bc-f867-4e29-b483-860812d70b34 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] 10.222.0.87 "GET /compute/v2.1/servers/1cf67257-a3ee-4cb2-bd74-d382b9d6e903" status: 200 len: 1314 microversion: 2.1 time: 0.175486 Oct 29 01:32:26.612145 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 299/588] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:26 2021] GET /compute/v2.1/servers/1cf67257-a3ee-4cb2-bd74-d382b9d6e903 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:32:27.372532 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-dbd9903e-b67c-4903-852d-f4c89bff34a6 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:27.373866 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-dbd9903e-b67c-4903-852d-f4c89bff34a6 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:27.382427 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-dbd9903e-b67c-4903-852d-f4c89bff34a6 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:27.383007 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-dbd9903e-b67c-4903-852d-f4c89bff34a6 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:27.384760 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-dbd9903e-b67c-4903-852d-f4c89bff34a6 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:27.385326 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-dbd9903e-b67c-4903-852d-f4c89bff34a6 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:27.410493 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-f42a6d2e-1581-4198-9669-59fa16c9001a tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:27.411433 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-f42a6d2e-1581-4198-9669-59fa16c9001a tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:27.418380 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-f42a6d2e-1581-4198-9669-59fa16c9001a tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:27.418826 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-f42a6d2e-1581-4198-9669-59fa16c9001a tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:27.419608 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-f42a6d2e-1581-4198-9669-59fa16c9001a tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:27.420065 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-f42a6d2e-1581-4198-9669-59fa16c9001a tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:27.454824 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-f42a6d2e-1581-4198-9669-59fa16c9001a tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048150 Oct 29 01:32:27.455417 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 300/589] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Oct 29 01:32:27 2021] GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:32:27.529263 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-dbd9903e-b67c-4903-852d-f4c89bff34a6 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:27.540016 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-dbd9903e-b67c-4903-852d-f4c89bff34a6 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:27.542300 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-dbd9903e-b67c-4903-852d-f4c89bff34a6 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:27.543848 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-dbd9903e-b67c-4903-852d-f4c89bff34a6 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1808 microversion: 2.20 time: 0.175209 Oct 29 01:32:27.544779 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 290/590] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:32:27 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:32:27.562208 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-0b91354e-d1cf-4787-b828-8dcb25a3a9ab tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:27.562810 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-0b91354e-d1cf-4787-b828-8dcb25a3a9ab tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] [instance: c49107f1-6a48-4184-8bb6-fa2f027193ba] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:27.618612 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-0b91354e-d1cf-4787-b828-8dcb25a3a9ab tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ad077fd0164d3c8b4db14262186901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa66fedc6704473996d04ffbf8135e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:27.629698 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-ade97d2b-7d8e-4126-aa32-bd86e2ba3d7b tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:27.629988 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-0b91354e-d1cf-4787-b828-8dcb25a3a9ab tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] 10.222.0.87 "GET /compute/v2.1/servers/c49107f1-6a48-4184-8bb6-fa2f027193ba" status: 200 len: 1218 microversion: 2.1 time: 0.071071 Oct 29 01:32:27.630511 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-ade97d2b-7d8e-4126-aa32-bd86e2ba3d7b tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] [instance: 1cf67257-a3ee-4cb2-bd74-d382b9d6e903] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:27.631002 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 301/591] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:27 2021] GET /compute/v2.1/servers/c49107f1-6a48-4184-8bb6-fa2f027193ba => generated 1218 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:32:27.638634 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-ade97d2b-7d8e-4126-aa32-bd86e2ba3d7b tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:27.639220 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-ade97d2b-7d8e-4126-aa32-bd86e2ba3d7b tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:27.640205 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-ade97d2b-7d8e-4126-aa32-bd86e2ba3d7b tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:27.642786 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-ade97d2b-7d8e-4126-aa32-bd86e2ba3d7b tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:27.781504 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-ade97d2b-7d8e-4126-aa32-bd86e2ba3d7b tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd18483ef44e4f83909d856b2ec64366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18626e87dcd742bca0e65ddb87d7b10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:27.789566 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-ade97d2b-7d8e-4126-aa32-bd86e2ba3d7b tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] 10.222.0.87 "GET /compute/v2.1/servers/1cf67257-a3ee-4cb2-bd74-d382b9d6e903" status: 200 len: 1314 microversion: 2.1 time: 0.164516 Oct 29 01:32:27.790266 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 291/592] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:27 2021] GET /compute/v2.1/servers/1cf67257-a3ee-4cb2-bd74-d382b9d6e903 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:32:28.466999 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-9848db8b-166b-4a8a-9a62-572fcfa29227 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:28.468040 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-9848db8b-166b-4a8a-9a62-572fcfa29227 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:28.476218 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-9848db8b-166b-4a8a-9a62-572fcfa29227 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:28.476724 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-9848db8b-166b-4a8a-9a62-572fcfa29227 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:28.477503 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-9848db8b-166b-4a8a-9a62-572fcfa29227 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:28.477949 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-9848db8b-166b-4a8a-9a62-572fcfa29227 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:28.521721 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-9848db8b-166b-4a8a-9a62-572fcfa29227 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058287 Oct 29 01:32:28.522209 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 302/593] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Oct 29 01:32:28 2021] GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:32:28.562154 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-66041020-9c73-43a3-a321-9aa79fa88107 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:28.562730 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-66041020-9c73-43a3-a321-9aa79fa88107 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:28.569207 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-66041020-9c73-43a3-a321-9aa79fa88107 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:28.569643 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-66041020-9c73-43a3-a321-9aa79fa88107 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:28.571208 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-66041020-9c73-43a3-a321-9aa79fa88107 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:28.571633 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-66041020-9c73-43a3-a321-9aa79fa88107 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:28.648100 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-048b4069-c150-4925-87c8-00b64bb16440 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:28.649378 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-048b4069-c150-4925-87c8-00b64bb16440 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] [instance: c49107f1-6a48-4184-8bb6-fa2f027193ba] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:28.655798 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-048b4069-c150-4925-87c8-00b64bb16440 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:28.656678 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-048b4069-c150-4925-87c8-00b64bb16440 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:28.657515 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-048b4069-c150-4925-87c8-00b64bb16440 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:28.658006 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-048b4069-c150-4925-87c8-00b64bb16440 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:28.743392 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-048b4069-c150-4925-87c8-00b64bb16440 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ad077fd0164d3c8b4db14262186901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa66fedc6704473996d04ffbf8135e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:28.750946 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-048b4069-c150-4925-87c8-00b64bb16440 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] 10.222.0.87 "GET /compute/v2.1/servers/c49107f1-6a48-4184-8bb6-fa2f027193ba" status: 200 len: 1222 microversion: 2.1 time: 0.108367 Oct 29 01:32:28.751519 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 303/594] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:28 2021] GET /compute/v2.1/servers/c49107f1-6a48-4184-8bb6-fa2f027193ba => generated 1222 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:32:28.762875 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-66041020-9c73-43a3-a321-9aa79fa88107 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:28.773009 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-66041020-9c73-43a3-a321-9aa79fa88107 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:28.774426 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-66041020-9c73-43a3-a321-9aa79fa88107 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:28.775628 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-66041020-9c73-43a3-a321-9aa79fa88107 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1808 microversion: 2.20 time: 0.217251 Oct 29 01:32:28.776249 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 292/595] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:32:28 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1808 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:32:28.807502 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-13b02860-232b-4001-b32a-18dc8b58238b tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:28.808117 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-13b02860-232b-4001-b32a-18dc8b58238b tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] [instance: 1cf67257-a3ee-4cb2-bd74-d382b9d6e903] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:28.814156 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-13b02860-232b-4001-b32a-18dc8b58238b tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:28.814591 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-13b02860-232b-4001-b32a-18dc8b58238b tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:28.815392 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-13b02860-232b-4001-b32a-18dc8b58238b tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:28.815789 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-13b02860-232b-4001-b32a-18dc8b58238b tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:28.949191 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-13b02860-232b-4001-b32a-18dc8b58238b tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd18483ef44e4f83909d856b2ec64366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18626e87dcd742bca0e65ddb87d7b10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:28.956935 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-13b02860-232b-4001-b32a-18dc8b58238b tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] 10.222.0.87 "GET /compute/v2.1/servers/1cf67257-a3ee-4cb2-bd74-d382b9d6e903" status: 200 len: 1314 microversion: 2.1 time: 0.154234 Oct 29 01:32:28.957498 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 304/596] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:28 2021] GET /compute/v2.1/servers/1cf67257-a3ee-4cb2-bd74-d382b9d6e903 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:32:29.534051 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-25256b09-c6b0-40ee-855c-831e4754939d tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:29.535041 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-25256b09-c6b0-40ee-855c-831e4754939d tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:29.541294 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-25256b09-c6b0-40ee-855c-831e4754939d tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:29.541744 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-25256b09-c6b0-40ee-855c-831e4754939d tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:29.542512 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-25256b09-c6b0-40ee-855c-831e4754939d tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:29.542954 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-25256b09-c6b0-40ee-855c-831e4754939d tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:29.572339 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-25256b09-c6b0-40ee-855c-831e4754939d tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042045 Oct 29 01:32:29.573070 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 293/597] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Oct 29 01:32:29 2021] GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:32:29.770790 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-72003a25-bf94-4ed7-9b2e-5c3694cff96b tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:29.772479 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-72003a25-bf94-4ed7-9b2e-5c3694cff96b tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] [instance: c49107f1-6a48-4184-8bb6-fa2f027193ba] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:29.780685 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-72003a25-bf94-4ed7-9b2e-5c3694cff96b tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:29.781211 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-72003a25-bf94-4ed7-9b2e-5c3694cff96b tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:29.782107 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-72003a25-bf94-4ed7-9b2e-5c3694cff96b tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:29.782540 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-72003a25-bf94-4ed7-9b2e-5c3694cff96b tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:29.794389 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-0d46f7f0-81d8-4146-91b7-7b22ef1dace9 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:29.794948 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-0d46f7f0-81d8-4146-91b7-7b22ef1dace9 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:29.801098 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-0d46f7f0-81d8-4146-91b7-7b22ef1dace9 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:29.801552 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-0d46f7f0-81d8-4146-91b7-7b22ef1dace9 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:29.802315 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-0d46f7f0-81d8-4146-91b7-7b22ef1dace9 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:29.802752 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-0d46f7f0-81d8-4146-91b7-7b22ef1dace9 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:29.845441 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-72003a25-bf94-4ed7-9b2e-5c3694cff96b tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ad077fd0164d3c8b4db14262186901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa66fedc6704473996d04ffbf8135e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:29.856579 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-72003a25-bf94-4ed7-9b2e-5c3694cff96b tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] 10.222.0.87 "GET /compute/v2.1/servers/c49107f1-6a48-4184-8bb6-fa2f027193ba" status: 200 len: 1222 microversion: 2.1 time: 0.091319 Oct 29 01:32:29.871949 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 305/598] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:29 2021] GET /compute/v2.1/servers/c49107f1-6a48-4184-8bb6-fa2f027193ba => generated 1222 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:32:29.943468 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-0d46f7f0-81d8-4146-91b7-7b22ef1dace9 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:29.952490 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-0d46f7f0-81d8-4146-91b7-7b22ef1dace9 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:29.953989 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-0d46f7f0-81d8-4146-91b7-7b22ef1dace9 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:29.955135 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-0d46f7f0-81d8-4146-91b7-7b22ef1dace9 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1808 microversion: 2.20 time: 0.164771 Oct 29 01:32:29.955689 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 294/599] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:32:29 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:32:29.974049 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-fabe27d8-1e8a-4755-b0f0-4b640e518e03 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:29.974673 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-fabe27d8-1e8a-4755-b0f0-4b640e518e03 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] [instance: 1cf67257-a3ee-4cb2-bd74-d382b9d6e903] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:29.980699 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-fabe27d8-1e8a-4755-b0f0-4b640e518e03 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:29.981275 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-fabe27d8-1e8a-4755-b0f0-4b640e518e03 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:29.981868 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-fabe27d8-1e8a-4755-b0f0-4b640e518e03 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:29.982285 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-fabe27d8-1e8a-4755-b0f0-4b640e518e03 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:30.114403 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-fabe27d8-1e8a-4755-b0f0-4b640e518e03 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd18483ef44e4f83909d856b2ec64366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18626e87dcd742bca0e65ddb87d7b10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:30.122552 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-fabe27d8-1e8a-4755-b0f0-4b640e518e03 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] 10.222.0.87 "GET /compute/v2.1/servers/1cf67257-a3ee-4cb2-bd74-d382b9d6e903" status: 200 len: 1314 microversion: 2.1 time: 0.152111 Oct 29 01:32:30.123120 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 306/600] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:29 2021] GET /compute/v2.1/servers/1cf67257-a3ee-4cb2-bd74-d382b9d6e903 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:32:30.583934 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-24f00ea5-690c-49a2-9b39-500b6993ed64 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:30.584879 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-24f00ea5-690c-49a2-9b39-500b6993ed64 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:30.590735 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-24f00ea5-690c-49a2-9b39-500b6993ed64 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:30.591240 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-24f00ea5-690c-49a2-9b39-500b6993ed64 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:30.592018 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-24f00ea5-690c-49a2-9b39-500b6993ed64 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:30.592443 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-24f00ea5-690c-49a2-9b39-500b6993ed64 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:30.621860 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-24f00ea5-690c-49a2-9b39-500b6993ed64 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041665 Oct 29 01:32:30.622814 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 295/601] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Oct 29 01:32:30 2021] GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:32:30.874057 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-a679ad09-4d67-4cc3-9a2c-cb49226eb471 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:30.874627 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-a679ad09-4d67-4cc3-9a2c-cb49226eb471 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] [instance: c49107f1-6a48-4184-8bb6-fa2f027193ba] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:30.881534 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a679ad09-4d67-4cc3-9a2c-cb49226eb471 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:30.882001 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a679ad09-4d67-4cc3-9a2c-cb49226eb471 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:30.882914 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a679ad09-4d67-4cc3-9a2c-cb49226eb471 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:30.883412 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a679ad09-4d67-4cc3-9a2c-cb49226eb471 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:30.967661 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-a679ad09-4d67-4cc3-9a2c-cb49226eb471 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ad077fd0164d3c8b4db14262186901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa66fedc6704473996d04ffbf8135e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:30.973469 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-9a29375b-a011-4be4-ada6-c477c2339bbb tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:30.974062 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-9a29375b-a011-4be4-ada6-c477c2339bbb tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:30.976074 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-a679ad09-4d67-4cc3-9a2c-cb49226eb471 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] 10.222.0.87 "GET /compute/v2.1/servers/c49107f1-6a48-4184-8bb6-fa2f027193ba" status: 200 len: 1222 microversion: 2.1 time: 0.105127 Oct 29 01:32:30.982909 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-9a29375b-a011-4be4-ada6-c477c2339bbb tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:30.983632 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-9a29375b-a011-4be4-ada6-c477c2339bbb tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:30.984641 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-9a29375b-a011-4be4-ada6-c477c2339bbb tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:30.985234 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-9a29375b-a011-4be4-ada6-c477c2339bbb tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:30.986807 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 307/602] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:30 2021] GET /compute/v2.1/servers/c49107f1-6a48-4184-8bb6-fa2f027193ba => generated 1222 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:32:31.136795 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-9a29375b-a011-4be4-ada6-c477c2339bbb tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:31.141312 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-71af671b-e722-4264-8421-a2c6142f13f1 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:31.141916 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-71af671b-e722-4264-8421-a2c6142f13f1 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] [instance: 1cf67257-a3ee-4cb2-bd74-d382b9d6e903] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:31.145564 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-9a29375b-a011-4be4-ada6-c477c2339bbb tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:31.147060 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-9a29375b-a011-4be4-ada6-c477c2339bbb tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:31.148966 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-9a29375b-a011-4be4-ada6-c477c2339bbb tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1808 microversion: 2.20 time: 0.179223 Oct 29 01:32:31.150448 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-71af671b-e722-4264-8421-a2c6142f13f1 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:31.150884 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-71af671b-e722-4264-8421-a2c6142f13f1 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:31.151768 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-71af671b-e722-4264-8421-a2c6142f13f1 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:31.152193 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-71af671b-e722-4264-8421-a2c6142f13f1 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:31.156669 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 296/603] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:32:30 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1808 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:32:31.302912 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-71af671b-e722-4264-8421-a2c6142f13f1 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd18483ef44e4f83909d856b2ec64366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18626e87dcd742bca0e65ddb87d7b10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:31.310916 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-71af671b-e722-4264-8421-a2c6142f13f1 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] 10.222.0.87 "GET /compute/v2.1/servers/1cf67257-a3ee-4cb2-bd74-d382b9d6e903" status: 200 len: 1314 microversion: 2.1 time: 0.174248 Oct 29 01:32:31.311474 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 308/604] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:31 2021] GET /compute/v2.1/servers/1cf67257-a3ee-4cb2-bd74-d382b9d6e903 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:32:31.633087 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-dc3966f3-0faa-4e21-ad6e-18bb9bfcaa5d tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:31.634015 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-dc3966f3-0faa-4e21-ad6e-18bb9bfcaa5d tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:31.640329 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-dc3966f3-0faa-4e21-ad6e-18bb9bfcaa5d tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:31.640781 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-dc3966f3-0faa-4e21-ad6e-18bb9bfcaa5d tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:31.641547 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-dc3966f3-0faa-4e21-ad6e-18bb9bfcaa5d tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:31.641970 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-dc3966f3-0faa-4e21-ad6e-18bb9bfcaa5d tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:31.673544 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-dc3966f3-0faa-4e21-ad6e-18bb9bfcaa5d tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044058 Oct 29 01:32:31.674096 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 297/605] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Oct 29 01:32:31 2021] GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:32:31.993956 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-a099a906-3817-4dce-b881-a79e2ebd2b36 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:31.994562 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-a099a906-3817-4dce-b881-a79e2ebd2b36 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] [instance: c49107f1-6a48-4184-8bb6-fa2f027193ba] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:32.000662 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a099a906-3817-4dce-b881-a79e2ebd2b36 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:32.001116 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a099a906-3817-4dce-b881-a79e2ebd2b36 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:32.001865 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a099a906-3817-4dce-b881-a79e2ebd2b36 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:32.002294 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a099a906-3817-4dce-b881-a79e2ebd2b36 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:32.063586 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-a099a906-3817-4dce-b881-a79e2ebd2b36 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ad077fd0164d3c8b4db14262186901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa66fedc6704473996d04ffbf8135e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:32.073794 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-a099a906-3817-4dce-b881-a79e2ebd2b36 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] 10.222.0.87 "GET /compute/v2.1/servers/c49107f1-6a48-4184-8bb6-fa2f027193ba" status: 200 len: 1222 microversion: 2.1 time: 0.083479 Oct 29 01:32:32.074844 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 309/606] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:31 2021] GET /compute/v2.1/servers/c49107f1-6a48-4184-8bb6-fa2f027193ba => generated 1222 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:32:32.167414 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-5917d078-62ac-4b43-ac1a-0894de9cbf98 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:32.168063 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-5917d078-62ac-4b43-ac1a-0894de9cbf98 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:32.174903 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-5917d078-62ac-4b43-ac1a-0894de9cbf98 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:32.175363 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-5917d078-62ac-4b43-ac1a-0894de9cbf98 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:32.176366 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-5917d078-62ac-4b43-ac1a-0894de9cbf98 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:32.177012 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-5917d078-62ac-4b43-ac1a-0894de9cbf98 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:32.329395 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-2bce861c-5083-46a1-9a5e-fbf09ac61ba6 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:32.330089 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-2bce861c-5083-46a1-9a5e-fbf09ac61ba6 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] [instance: 1cf67257-a3ee-4cb2-bd74-d382b9d6e903] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:32.338194 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-2bce861c-5083-46a1-9a5e-fbf09ac61ba6 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:32.338706 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-2bce861c-5083-46a1-9a5e-fbf09ac61ba6 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:32.339479 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-2bce861c-5083-46a1-9a5e-fbf09ac61ba6 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:32.339957 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-2bce861c-5083-46a1-9a5e-fbf09ac61ba6 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:32.343583 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-5917d078-62ac-4b43-ac1a-0894de9cbf98 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:32.355351 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-5917d078-62ac-4b43-ac1a-0894de9cbf98 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:32.357177 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-5917d078-62ac-4b43-ac1a-0894de9cbf98 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:32.358295 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-5917d078-62ac-4b43-ac1a-0894de9cbf98 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1808 microversion: 2.20 time: 0.195664 Oct 29 01:32:32.361568 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 298/607] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:32:32 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1808 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:32:32.479642 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-2bce861c-5083-46a1-9a5e-fbf09ac61ba6 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd18483ef44e4f83909d856b2ec64366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18626e87dcd742bca0e65ddb87d7b10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:32.488637 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-2bce861c-5083-46a1-9a5e-fbf09ac61ba6 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] 10.222.0.87 "GET /compute/v2.1/servers/1cf67257-a3ee-4cb2-bd74-d382b9d6e903" status: 200 len: 1314 microversion: 2.1 time: 0.163260 Oct 29 01:32:32.489337 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 310/608] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:32 2021] GET /compute/v2.1/servers/1cf67257-a3ee-4cb2-bd74-d382b9d6e903 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:32:32.684209 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-0109d3a0-69cc-453b-89bc-fe03585191d2 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:32.685111 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-0109d3a0-69cc-453b-89bc-fe03585191d2 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:32.690833 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-0109d3a0-69cc-453b-89bc-fe03585191d2 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:32.691270 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-0109d3a0-69cc-453b-89bc-fe03585191d2 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:32.692051 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-0109d3a0-69cc-453b-89bc-fe03585191d2 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:32.692477 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-0109d3a0-69cc-453b-89bc-fe03585191d2 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:32.731144 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-0109d3a0-69cc-453b-89bc-fe03585191d2 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051139 Oct 29 01:32:32.731890 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 299/609] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Oct 29 01:32:32 2021] GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:32:33.091513 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-bddf308f-7be8-43a0-87a6-8c2f845cd55a tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:33.092422 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-bddf308f-7be8-43a0-87a6-8c2f845cd55a tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] [instance: c49107f1-6a48-4184-8bb6-fa2f027193ba] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:33.098987 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-bddf308f-7be8-43a0-87a6-8c2f845cd55a tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:33.099426 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-bddf308f-7be8-43a0-87a6-8c2f845cd55a tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:33.100426 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-bddf308f-7be8-43a0-87a6-8c2f845cd55a tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:33.100855 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-bddf308f-7be8-43a0-87a6-8c2f845cd55a tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:33.165910 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-bddf308f-7be8-43a0-87a6-8c2f845cd55a tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ad077fd0164d3c8b4db14262186901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa66fedc6704473996d04ffbf8135e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:33.173335 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-bddf308f-7be8-43a0-87a6-8c2f845cd55a tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] 10.222.0.87 "GET /compute/v2.1/servers/c49107f1-6a48-4184-8bb6-fa2f027193ba" status: 200 len: 1222 microversion: 2.1 time: 0.085979 Oct 29 01:32:33.173895 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 311/610] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:33 2021] GET /compute/v2.1/servers/c49107f1-6a48-4184-8bb6-fa2f027193ba => generated 1222 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:32:33.379422 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-33bc6859-edf1-40a4-bdc7-fdef0515053a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:33.380172 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-33bc6859-edf1-40a4-bdc7-fdef0515053a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:33.387026 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-33bc6859-edf1-40a4-bdc7-fdef0515053a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:33.391302 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-33bc6859-edf1-40a4-bdc7-fdef0515053a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:33.391302 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-33bc6859-edf1-40a4-bdc7-fdef0515053a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:33.391302 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-33bc6859-edf1-40a4-bdc7-fdef0515053a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:33.506973 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-43027686-a9b9-4c24-a02a-e929229eb72d tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:33.508055 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-43027686-a9b9-4c24-a02a-e929229eb72d tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] [instance: 1cf67257-a3ee-4cb2-bd74-d382b9d6e903] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:33.515086 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-43027686-a9b9-4c24-a02a-e929229eb72d tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:33.515526 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-43027686-a9b9-4c24-a02a-e929229eb72d tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:33.516320 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-43027686-a9b9-4c24-a02a-e929229eb72d tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:33.516741 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-43027686-a9b9-4c24-a02a-e929229eb72d tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:33.519970 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-33bc6859-edf1-40a4-bdc7-fdef0515053a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:33.529667 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-33bc6859-edf1-40a4-bdc7-fdef0515053a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:33.531294 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-33bc6859-edf1-40a4-bdc7-fdef0515053a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:33.532595 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-33bc6859-edf1-40a4-bdc7-fdef0515053a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1808 microversion: 2.20 time: 0.156745 Oct 29 01:32:33.533416 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 300/611] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:32:33 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:32:33.637115 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-43027686-a9b9-4c24-a02a-e929229eb72d tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd18483ef44e4f83909d856b2ec64366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18626e87dcd742bca0e65ddb87d7b10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:33.644965 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-43027686-a9b9-4c24-a02a-e929229eb72d tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] 10.222.0.87 "GET /compute/v2.1/servers/1cf67257-a3ee-4cb2-bd74-d382b9d6e903" status: 200 len: 1314 microversion: 2.1 time: 0.142429 Oct 29 01:32:33.645839 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 312/612] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:33 2021] GET /compute/v2.1/servers/1cf67257-a3ee-4cb2-bd74-d382b9d6e903 => generated 1314 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:32:33.743339 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-014e4c93-e468-4238-8fc5-90d7a8d51995 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:33.743339 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-014e4c93-e468-4238-8fc5-90d7a8d51995 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:33.758584 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-014e4c93-e468-4238-8fc5-90d7a8d51995 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:33.759944 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-014e4c93-e468-4238-8fc5-90d7a8d51995 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:33.761112 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-014e4c93-e468-4238-8fc5-90d7a8d51995 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:33.761888 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-014e4c93-e468-4238-8fc5-90d7a8d51995 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:33.793530 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-014e4c93-e468-4238-8fc5-90d7a8d51995 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055075 Oct 29 01:32:33.794097 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 301/613] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Oct 29 01:32:33 2021] GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:32:33.869296 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 01:32:33.869538 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: Fri Oct 29 01:32:33 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 29 01:32:34.189963 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-c8afb44c-d284-4957-91b4-fdfebec40e04 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:34.190590 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-c8afb44c-d284-4957-91b4-fdfebec40e04 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] [instance: c49107f1-6a48-4184-8bb6-fa2f027193ba] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:34.198354 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c8afb44c-d284-4957-91b4-fdfebec40e04 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:34.198897 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c8afb44c-d284-4957-91b4-fdfebec40e04 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:34.199689 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c8afb44c-d284-4957-91b4-fdfebec40e04 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:34.200250 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c8afb44c-d284-4957-91b4-fdfebec40e04 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:34.286446 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-c8afb44c-d284-4957-91b4-fdfebec40e04 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ad077fd0164d3c8b4db14262186901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa66fedc6704473996d04ffbf8135e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:34.295086 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-c8afb44c-d284-4957-91b4-fdfebec40e04 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] 10.222.0.87 "GET /compute/v2.1/servers/c49107f1-6a48-4184-8bb6-fa2f027193ba" status: 200 len: 1222 microversion: 2.1 time: 0.108735 Oct 29 01:32:34.299149 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 313/614] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:34 2021] GET /compute/v2.1/servers/c49107f1-6a48-4184-8bb6-fa2f027193ba => generated 1222 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:32:34.417728 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 01:32:34.417950 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: Fri Oct 29 01:32:34 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 29 01:32:34.552270 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-b82f31ed-9de8-474f-baf3-a3e8e1d5f269 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:34.553295 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-b82f31ed-9de8-474f-baf3-a3e8e1d5f269 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:34.562441 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-b82f31ed-9de8-474f-baf3-a3e8e1d5f269 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:34.563034 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-b82f31ed-9de8-474f-baf3-a3e8e1d5f269 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:34.563983 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-b82f31ed-9de8-474f-baf3-a3e8e1d5f269 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:34.564491 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-b82f31ed-9de8-474f-baf3-a3e8e1d5f269 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:34.662272 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-a3475bae-6ab7-4140-bf31-cbb5924d853b tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:34.663813 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-a3475bae-6ab7-4140-bf31-cbb5924d853b tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] [instance: 1cf67257-a3ee-4cb2-bd74-d382b9d6e903] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:34.669883 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a3475bae-6ab7-4140-bf31-cbb5924d853b tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:34.670378 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a3475bae-6ab7-4140-bf31-cbb5924d853b tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:34.682751 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a3475bae-6ab7-4140-bf31-cbb5924d853b tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:34.683360 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a3475bae-6ab7-4140-bf31-cbb5924d853b tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:34.694205 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-b82f31ed-9de8-474f-baf3-a3e8e1d5f269 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:34.708510 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-b82f31ed-9de8-474f-baf3-a3e8e1d5f269 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:34.709372 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-b82f31ed-9de8-474f-baf3-a3e8e1d5f269 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:34.710570 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-b82f31ed-9de8-474f-baf3-a3e8e1d5f269 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1808 microversion: 2.20 time: 0.162549 Oct 29 01:32:34.711443 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 302/615] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:32:34 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:32:34.805385 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-69b637ee-a6d3-4fe4-9c9f-1e2426b245db tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:34.806378 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-69b637ee-a6d3-4fe4-9c9f-1e2426b245db tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:34.812656 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-69b637ee-a6d3-4fe4-9c9f-1e2426b245db tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:34.813175 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-69b637ee-a6d3-4fe4-9c9f-1e2426b245db tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:34.814071 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-69b637ee-a6d3-4fe4-9c9f-1e2426b245db tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:34.814518 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-69b637ee-a6d3-4fe4-9c9f-1e2426b245db tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:34.823673 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-a3475bae-6ab7-4140-bf31-cbb5924d853b tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd18483ef44e4f83909d856b2ec64366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18626e87dcd742bca0e65ddb87d7b10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:34.835330 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-a3475bae-6ab7-4140-bf31-cbb5924d853b tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] 10.222.0.87 "GET /compute/v2.1/servers/1cf67257-a3ee-4cb2-bd74-d382b9d6e903" status: 200 len: 1314 microversion: 2.1 time: 0.176717 Oct 29 01:32:34.835929 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 314/616] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:34 2021] GET /compute/v2.1/servers/1cf67257-a3ee-4cb2-bd74-d382b9d6e903 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:32:34.847702 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-69b637ee-a6d3-4fe4-9c9f-1e2426b245db tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046244 Oct 29 01:32:34.848269 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 303/617] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Oct 29 01:32:34 2021] GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:32:35.312433 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-4da20753-f058-4699-9c2c-471a5d3b46a7 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:35.313078 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-4da20753-f058-4699-9c2c-471a5d3b46a7 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] [instance: c49107f1-6a48-4184-8bb6-fa2f027193ba] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:35.319340 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4da20753-f058-4699-9c2c-471a5d3b46a7 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:35.319823 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4da20753-f058-4699-9c2c-471a5d3b46a7 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:35.320584 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4da20753-f058-4699-9c2c-471a5d3b46a7 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:35.321002 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4da20753-f058-4699-9c2c-471a5d3b46a7 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:35.380768 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-4da20753-f058-4699-9c2c-471a5d3b46a7 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ad077fd0164d3c8b4db14262186901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa66fedc6704473996d04ffbf8135e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:35.391036 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-4da20753-f058-4699-9c2c-471a5d3b46a7 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] 10.222.0.87 "GET /compute/v2.1/servers/c49107f1-6a48-4184-8bb6-fa2f027193ba" status: 200 len: 1222 microversion: 2.1 time: 0.082427 Oct 29 01:32:35.393627 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 315/618] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:35 2021] GET /compute/v2.1/servers/c49107f1-6a48-4184-8bb6-fa2f027193ba => generated 1222 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:32:35.729611 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-47465b8d-f9f1-4561-9ebd-e0c5c2bc443d tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:35.730198 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-47465b8d-f9f1-4561-9ebd-e0c5c2bc443d tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:35.736382 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-47465b8d-f9f1-4561-9ebd-e0c5c2bc443d tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:35.736822 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-47465b8d-f9f1-4561-9ebd-e0c5c2bc443d tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:35.737576 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-47465b8d-f9f1-4561-9ebd-e0c5c2bc443d tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:35.738002 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-47465b8d-f9f1-4561-9ebd-e0c5c2bc443d tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:35.853963 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-e70f6a99-faec-44b0-a2aa-7af0562d103d tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:35.854891 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-e70f6a99-faec-44b0-a2aa-7af0562d103d tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] [instance: 1cf67257-a3ee-4cb2-bd74-d382b9d6e903] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:35.861643 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-e70f6a99-faec-44b0-a2aa-7af0562d103d tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:35.862123 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-e70f6a99-faec-44b0-a2aa-7af0562d103d tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:35.863122 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-e70f6a99-faec-44b0-a2aa-7af0562d103d tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:35.863565 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-e70f6a99-faec-44b0-a2aa-7af0562d103d tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:35.872485 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-47465b8d-f9f1-4561-9ebd-e0c5c2bc443d tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:35.897818 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-47465b8d-f9f1-4561-9ebd-e0c5c2bc443d tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:35.897818 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-47465b8d-f9f1-4561-9ebd-e0c5c2bc443d tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:35.897818 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-47465b8d-f9f1-4561-9ebd-e0c5c2bc443d tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1808 microversion: 2.20 time: 0.160849 Oct 29 01:32:35.898158 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 304/619] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:32:35 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:32:35.900857 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-3a11e87d-16ca-43c4-b529-417f84172296 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:35.901851 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-3a11e87d-16ca-43c4-b529-417f84172296 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:35.916637 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-3a11e87d-16ca-43c4-b529-417f84172296 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:35.917363 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-3a11e87d-16ca-43c4-b529-417f84172296 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:35.918387 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-3a11e87d-16ca-43c4-b529-417f84172296 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:35.919035 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-3a11e87d-16ca-43c4-b529-417f84172296 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:35.951138 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-3a11e87d-16ca-43c4-b529-417f84172296 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062867 Oct 29 01:32:35.952111 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 305/620] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Oct 29 01:32:35 2021] GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:32:36.004846 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-e70f6a99-faec-44b0-a2aa-7af0562d103d tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd18483ef44e4f83909d856b2ec64366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18626e87dcd742bca0e65ddb87d7b10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:36.014723 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-e70f6a99-faec-44b0-a2aa-7af0562d103d tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] 10.222.0.87 "GET /compute/v2.1/servers/1cf67257-a3ee-4cb2-bd74-d382b9d6e903" status: 200 len: 1314 microversion: 2.1 time: 0.165366 Oct 29 01:32:36.015299 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 316/621] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:35 2021] GET /compute/v2.1/servers/1cf67257-a3ee-4cb2-bd74-d382b9d6e903 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:32:36.408241 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-5db341d0-3bb9-4aed-b2c7-c48cd900d89b tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:36.408749 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-5db341d0-3bb9-4aed-b2c7-c48cd900d89b tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] [instance: c49107f1-6a48-4184-8bb6-fa2f027193ba] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:36.414656 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-5db341d0-3bb9-4aed-b2c7-c48cd900d89b tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:36.415715 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-5db341d0-3bb9-4aed-b2c7-c48cd900d89b tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:36.416598 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-5db341d0-3bb9-4aed-b2c7-c48cd900d89b tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:36.417025 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-5db341d0-3bb9-4aed-b2c7-c48cd900d89b tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:36.483244 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-5db341d0-3bb9-4aed-b2c7-c48cd900d89b tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ad077fd0164d3c8b4db14262186901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa66fedc6704473996d04ffbf8135e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:36.490970 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-5db341d0-3bb9-4aed-b2c7-c48cd900d89b tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] 10.222.0.87 "GET /compute/v2.1/servers/c49107f1-6a48-4184-8bb6-fa2f027193ba" status: 200 len: 1222 microversion: 2.1 time: 0.086371 Oct 29 01:32:36.491537 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 306/622] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:36 2021] GET /compute/v2.1/servers/c49107f1-6a48-4184-8bb6-fa2f027193ba => generated 1222 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:32:36.927009 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-f3c55798-8f45-4c1e-82ed-7c7326f12a8a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:36.927009 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-f3c55798-8f45-4c1e-82ed-7c7326f12a8a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:36.927009 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-f3c55798-8f45-4c1e-82ed-7c7326f12a8a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:36.927009 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-f3c55798-8f45-4c1e-82ed-7c7326f12a8a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:36.928461 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-f3c55798-8f45-4c1e-82ed-7c7326f12a8a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:36.928461 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-f3c55798-8f45-4c1e-82ed-7c7326f12a8a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:36.964146 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-9a5fd3ec-44e8-48ef-90e7-ff9b0bf408f4 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:36.966150 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-9a5fd3ec-44e8-48ef-90e7-ff9b0bf408f4 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:36.974554 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-9a5fd3ec-44e8-48ef-90e7-ff9b0bf408f4 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:36.975900 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-9a5fd3ec-44e8-48ef-90e7-ff9b0bf408f4 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:36.976930 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-9a5fd3ec-44e8-48ef-90e7-ff9b0bf408f4 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:36.977827 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-9a5fd3ec-44e8-48ef-90e7-ff9b0bf408f4 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:37.021145 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-9a5fd3ec-44e8-48ef-90e7-ff9b0bf408f4 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062409 Oct 29 01:32:37.021875 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 307/623] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Oct 29 01:32:36 2021] GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:32:37.032796 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-7dcdc4e0-6e7c-4531-8fb9-86e1a53bcfa9 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:37.033430 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-7dcdc4e0-6e7c-4531-8fb9-86e1a53bcfa9 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] [instance: 1cf67257-a3ee-4cb2-bd74-d382b9d6e903] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:37.041738 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-7dcdc4e0-6e7c-4531-8fb9-86e1a53bcfa9 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:37.042189 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-7dcdc4e0-6e7c-4531-8fb9-86e1a53bcfa9 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:37.047934 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-7dcdc4e0-6e7c-4531-8fb9-86e1a53bcfa9 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:37.047934 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-7dcdc4e0-6e7c-4531-8fb9-86e1a53bcfa9 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:37.060918 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-f3c55798-8f45-4c1e-82ed-7c7326f12a8a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:37.073166 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-f3c55798-8f45-4c1e-82ed-7c7326f12a8a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:37.074983 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-f3c55798-8f45-4c1e-82ed-7c7326f12a8a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:37.077981 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-f3c55798-8f45-4c1e-82ed-7c7326f12a8a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1808 microversion: 2.20 time: 0.176356 Oct 29 01:32:37.079791 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 317/624] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:32:36 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1808 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:32:37.183852 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-7dcdc4e0-6e7c-4531-8fb9-86e1a53bcfa9 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd18483ef44e4f83909d856b2ec64366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18626e87dcd742bca0e65ddb87d7b10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:37.194105 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-7dcdc4e0-6e7c-4531-8fb9-86e1a53bcfa9 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] 10.222.0.87 "GET /compute/v2.1/servers/1cf67257-a3ee-4cb2-bd74-d382b9d6e903" status: 200 len: 1314 microversion: 2.1 time: 0.165101 Oct 29 01:32:37.198616 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 308/625] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:37 2021] GET /compute/v2.1/servers/1cf67257-a3ee-4cb2-bd74-d382b9d6e903 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:32:37.514111 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-51472634-7c99-4cb7-b5f4-182512d6701b tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:37.514865 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-51472634-7c99-4cb7-b5f4-182512d6701b tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] [instance: c49107f1-6a48-4184-8bb6-fa2f027193ba] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:37.521029 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-51472634-7c99-4cb7-b5f4-182512d6701b tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:37.521816 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-51472634-7c99-4cb7-b5f4-182512d6701b tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:37.522830 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-51472634-7c99-4cb7-b5f4-182512d6701b tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:37.523494 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-51472634-7c99-4cb7-b5f4-182512d6701b tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:37.592441 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-51472634-7c99-4cb7-b5f4-182512d6701b tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ad077fd0164d3c8b4db14262186901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa66fedc6704473996d04ffbf8135e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:37.599628 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-51472634-7c99-4cb7-b5f4-182512d6701b tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] 10.222.0.87 "GET /compute/v2.1/servers/c49107f1-6a48-4184-8bb6-fa2f027193ba" status: 200 len: 1222 microversion: 2.1 time: 0.095421 Oct 29 01:32:37.600324 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 318/626] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:37 2021] GET /compute/v2.1/servers/c49107f1-6a48-4184-8bb6-fa2f027193ba => generated 1222 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:32:38.033412 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-803de063-4a9e-45a7-ab1f-e6b845d2e2b4 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:38.034584 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-803de063-4a9e-45a7-ab1f-e6b845d2e2b4 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:38.041362 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-803de063-4a9e-45a7-ab1f-e6b845d2e2b4 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:38.041700 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-803de063-4a9e-45a7-ab1f-e6b845d2e2b4 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:38.047245 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-803de063-4a9e-45a7-ab1f-e6b845d2e2b4 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:38.047245 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-803de063-4a9e-45a7-ab1f-e6b845d2e2b4 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:38.076107 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-803de063-4a9e-45a7-ab1f-e6b845d2e2b4 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046555 Oct 29 01:32:38.077129 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 309/627] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Oct 29 01:32:38 2021] GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:32:38.097463 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-f7a65c78-0c31-451c-9662-a6bfd1150524 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:38.098083 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-f7a65c78-0c31-451c-9662-a6bfd1150524 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:38.104393 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-f7a65c78-0c31-451c-9662-a6bfd1150524 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:38.104832 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-f7a65c78-0c31-451c-9662-a6bfd1150524 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:38.105587 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-f7a65c78-0c31-451c-9662-a6bfd1150524 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:38.106010 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-f7a65c78-0c31-451c-9662-a6bfd1150524 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:38.214862 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-803efb77-4743-4cc3-87a9-4b291bf1c45f tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:38.215461 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-803efb77-4743-4cc3-87a9-4b291bf1c45f tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] [instance: 1cf67257-a3ee-4cb2-bd74-d382b9d6e903] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:38.221793 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-803efb77-4743-4cc3-87a9-4b291bf1c45f tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:38.222249 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-803efb77-4743-4cc3-87a9-4b291bf1c45f tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:38.223168 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-803efb77-4743-4cc3-87a9-4b291bf1c45f tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:38.223612 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-803efb77-4743-4cc3-87a9-4b291bf1c45f tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:38.240357 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-f7a65c78-0c31-451c-9662-a6bfd1150524 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:38.250356 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-f7a65c78-0c31-451c-9662-a6bfd1150524 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:38.252258 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-f7a65c78-0c31-451c-9662-a6bfd1150524 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:38.253599 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-f7a65c78-0c31-451c-9662-a6bfd1150524 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1808 microversion: 2.20 time: 0.159683 Oct 29 01:32:38.254324 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 319/628] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:32:38 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:32:38.365245 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-803efb77-4743-4cc3-87a9-4b291bf1c45f tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd18483ef44e4f83909d856b2ec64366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18626e87dcd742bca0e65ddb87d7b10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:38.374045 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-803efb77-4743-4cc3-87a9-4b291bf1c45f tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] 10.222.0.87 "GET /compute/v2.1/servers/1cf67257-a3ee-4cb2-bd74-d382b9d6e903" status: 200 len: 1314 microversion: 2.1 time: 0.164226 Oct 29 01:32:38.374604 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 310/629] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:38 2021] GET /compute/v2.1/servers/1cf67257-a3ee-4cb2-bd74-d382b9d6e903 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:32:38.616656 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-db6225fd-a92a-40c5-a461-dd1e151b7649 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:38.617258 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-db6225fd-a92a-40c5-a461-dd1e151b7649 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] [instance: c49107f1-6a48-4184-8bb6-fa2f027193ba] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:38.623850 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-db6225fd-a92a-40c5-a461-dd1e151b7649 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:38.624302 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-db6225fd-a92a-40c5-a461-dd1e151b7649 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:38.625071 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-db6225fd-a92a-40c5-a461-dd1e151b7649 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:38.625492 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-db6225fd-a92a-40c5-a461-dd1e151b7649 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:38.687093 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-db6225fd-a92a-40c5-a461-dd1e151b7649 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ad077fd0164d3c8b4db14262186901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa66fedc6704473996d04ffbf8135e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:38.694372 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-db6225fd-a92a-40c5-a461-dd1e151b7649 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] 10.222.0.87 "GET /compute/v2.1/servers/c49107f1-6a48-4184-8bb6-fa2f027193ba" status: 200 len: 1222 microversion: 2.1 time: 0.081317 Oct 29 01:32:38.694986 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 320/630] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:38 2021] GET /compute/v2.1/servers/c49107f1-6a48-4184-8bb6-fa2f027193ba => generated 1222 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:32:39.088222 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-a967fb94-3bfe-40ac-9789-6c04cb67f997 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:39.089913 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-a967fb94-3bfe-40ac-9789-6c04cb67f997 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:39.098097 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-a967fb94-3bfe-40ac-9789-6c04cb67f997 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:39.103949 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-a967fb94-3bfe-40ac-9789-6c04cb67f997 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:39.103949 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-a967fb94-3bfe-40ac-9789-6c04cb67f997 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:39.103949 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-a967fb94-3bfe-40ac-9789-6c04cb67f997 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:39.133797 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-a967fb94-3bfe-40ac-9789-6c04cb67f997 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049618 Oct 29 01:32:39.135689 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 311/631] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Oct 29 01:32:39 2021] GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:32:39.272786 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-329c4cf8-59de-40cc-be35-9fbaa7587b11 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:39.273333 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-329c4cf8-59de-40cc-be35-9fbaa7587b11 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:39.279568 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-329c4cf8-59de-40cc-be35-9fbaa7587b11 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:39.280048 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-329c4cf8-59de-40cc-be35-9fbaa7587b11 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:39.280827 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-329c4cf8-59de-40cc-be35-9fbaa7587b11 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:39.281356 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-329c4cf8-59de-40cc-be35-9fbaa7587b11 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:39.390731 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-a81df0b2-1366-4ccc-9ad1-0cdd1bf7cf50 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:39.391330 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-a81df0b2-1366-4ccc-9ad1-0cdd1bf7cf50 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] [instance: 1cf67257-a3ee-4cb2-bd74-d382b9d6e903] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:39.399535 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-a81df0b2-1366-4ccc-9ad1-0cdd1bf7cf50 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:39.400201 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-a81df0b2-1366-4ccc-9ad1-0cdd1bf7cf50 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:39.401756 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-a81df0b2-1366-4ccc-9ad1-0cdd1bf7cf50 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:39.402307 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-a81df0b2-1366-4ccc-9ad1-0cdd1bf7cf50 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:39.566465 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-329c4cf8-59de-40cc-be35-9fbaa7587b11 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:39.575924 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-329c4cf8-59de-40cc-be35-9fbaa7587b11 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:39.577678 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-329c4cf8-59de-40cc-be35-9fbaa7587b11 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:39.578852 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-329c4cf8-59de-40cc-be35-9fbaa7587b11 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1808 microversion: 2.20 time: 0.310123 Oct 29 01:32:39.579404 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 321/632] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:32:39 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1808 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:32:39.651838 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-a81df0b2-1366-4ccc-9ad1-0cdd1bf7cf50 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd18483ef44e4f83909d856b2ec64366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18626e87dcd742bca0e65ddb87d7b10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:39.669657 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-a81df0b2-1366-4ccc-9ad1-0cdd1bf7cf50 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] 10.222.0.87 "GET /compute/v2.1/servers/1cf67257-a3ee-4cb2-bd74-d382b9d6e903" status: 200 len: 1314 microversion: 2.1 time: 0.282226 Oct 29 01:32:39.670863 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 312/633] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:39 2021] GET /compute/v2.1/servers/1cf67257-a3ee-4cb2-bd74-d382b9d6e903 => generated 1314 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:32:39.712184 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-6350f83c-f989-4204-a66b-e5912ca592d3 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:39.714385 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-6350f83c-f989-4204-a66b-e5912ca592d3 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] [instance: c49107f1-6a48-4184-8bb6-fa2f027193ba] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:39.720321 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-6350f83c-f989-4204-a66b-e5912ca592d3 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:39.726046 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-6350f83c-f989-4204-a66b-e5912ca592d3 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:39.726046 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-6350f83c-f989-4204-a66b-e5912ca592d3 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:39.726046 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-6350f83c-f989-4204-a66b-e5912ca592d3 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:39.786275 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-6350f83c-f989-4204-a66b-e5912ca592d3 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ad077fd0164d3c8b4db14262186901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa66fedc6704473996d04ffbf8135e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:39.794824 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-6350f83c-f989-4204-a66b-e5912ca592d3 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] 10.222.0.87 "GET /compute/v2.1/servers/c49107f1-6a48-4184-8bb6-fa2f027193ba" status: 200 len: 1270 microversion: 2.1 time: 0.086581 Oct 29 01:32:39.794824 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 322/634] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:39 2021] GET /compute/v2.1/servers/c49107f1-6a48-4184-8bb6-fa2f027193ba => generated 1270 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:32:40.146404 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-246ab6e6-63d4-42f6-89a6-631e08892293 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:40.147457 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-246ab6e6-63d4-42f6-89a6-631e08892293 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:40.155361 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-246ab6e6-63d4-42f6-89a6-631e08892293 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:40.155838 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-246ab6e6-63d4-42f6-89a6-631e08892293 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:40.156614 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-246ab6e6-63d4-42f6-89a6-631e08892293 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:40.157394 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-246ab6e6-63d4-42f6-89a6-631e08892293 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:40.189407 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-246ab6e6-63d4-42f6-89a6-631e08892293 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046756 Oct 29 01:32:40.189991 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 313/635] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Oct 29 01:32:40 2021] GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:32:40.595661 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-8d1155d5-1811-49d4-80c1-68be4e141d1d tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:40.596243 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-8d1155d5-1811-49d4-80c1-68be4e141d1d tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:40.597620 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-aa151246-1697-4ca1-9dd0-b4987a639eb1 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:40.598515 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-aa151246-1697-4ca1-9dd0-b4987a639eb1 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:40.605945 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-aa151246-1697-4ca1-9dd0-b4987a639eb1 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:40.606628 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-aa151246-1697-4ca1-9dd0-b4987a639eb1 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:40.607844 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-aa151246-1697-4ca1-9dd0-b4987a639eb1 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:40.608459 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-8d1155d5-1811-49d4-80c1-68be4e141d1d tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:40.608617 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-aa151246-1697-4ca1-9dd0-b4987a639eb1 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:40.609226 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-8d1155d5-1811-49d4-80c1-68be4e141d1d tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:40.610371 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-8d1155d5-1811-49d4-80c1-68be4e141d1d tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:40.610968 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-8d1155d5-1811-49d4-80c1-68be4e141d1d tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:40.755470 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.objects.instance [None req-8d1155d5-1811-49d4-80c1-68be4e141d1d tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lazy-loading 'services' on Instance uuid 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92 {{(pid=116378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 01:32:40.865053 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-aa151246-1697-4ca1-9dd0-b4987a639eb1 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:40.880025 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-aa151246-1697-4ca1-9dd0-b4987a639eb1 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:40.881564 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-aa151246-1697-4ca1-9dd0-b4987a639eb1 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:40.882667 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-aa151246-1697-4ca1-9dd0-b4987a639eb1 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1808 microversion: 2.20 time: 0.289077 Oct 29 01:32:40.883255 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 314/636] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:32:40 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1808 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:32:40.888416 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-03e0c39d-fb11-4e0f-9d7f-d90abd9c12f3 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:40.889013 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-03e0c39d-fb11-4e0f-9d7f-d90abd9c12f3 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] [instance: 1cf67257-a3ee-4cb2-bd74-d382b9d6e903] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:40.894794 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-03e0c39d-fb11-4e0f-9d7f-d90abd9c12f3 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:40.895277 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-03e0c39d-fb11-4e0f-9d7f-d90abd9c12f3 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:40.896090 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-03e0c39d-fb11-4e0f-9d7f-d90abd9c12f3 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:40.896546 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-03e0c39d-fb11-4e0f-9d7f-d90abd9c12f3 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:41.024576 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-8d1155d5-1811-49d4-80c1-68be4e141d1d tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "DELETE /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/os-volume_attachments/3e313999-d4ea-4bed-942f-9e61f14fff8c" status: 202 len: 0 microversion: 2.1 time: 0.433205 Oct 29 01:32:41.025220 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 323/637] 10.222.0.87 () {58 vars in 1415 bytes} [Fri Oct 29 01:32:40 2021] DELETE /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/os-volume_attachments/3e313999-d4ea-4bed-942f-9e61f14fff8c => generated 0 bytes in 435 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:32:41.031388 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-e7012688-e55c-4722-a144-43bd0b46aae7 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:41.032071 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-e7012688-e55c-4722-a144-43bd0b46aae7 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] [instance: c49107f1-6a48-4184-8bb6-fa2f027193ba] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:41.039150 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-e7012688-e55c-4722-a144-43bd0b46aae7 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:41.039607 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-e7012688-e55c-4722-a144-43bd0b46aae7 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:41.040528 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-e7012688-e55c-4722-a144-43bd0b46aae7 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:41.041232 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-e7012688-e55c-4722-a144-43bd0b46aae7 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:41.280968 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-e7012688-e55c-4722-a144-43bd0b46aae7 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ad077fd0164d3c8b4db14262186901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa66fedc6704473996d04ffbf8135e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:41.288399 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-e7012688-e55c-4722-a144-43bd0b46aae7 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] 10.222.0.87 "GET /compute/v2.1/servers/c49107f1-6a48-4184-8bb6-fa2f027193ba" status: 200 len: 1276 microversion: 2.1 time: 0.261470 Oct 29 01:32:41.290866 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 324/638] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:41 2021] GET /compute/v2.1/servers/c49107f1-6a48-4184-8bb6-fa2f027193ba => generated 1276 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:32:41.402592 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-03e0c39d-fb11-4e0f-9d7f-d90abd9c12f3 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd18483ef44e4f83909d856b2ec64366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18626e87dcd742bca0e65ddb87d7b10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:41.407940 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-03e0c39d-fb11-4e0f-9d7f-d90abd9c12f3 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] 10.222.0.87 "GET /compute/v2.1/servers/1cf67257-a3ee-4cb2-bd74-d382b9d6e903" status: 200 len: 1314 microversion: 2.1 time: 0.523465 Oct 29 01:32:41.408504 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 315/639] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:40 2021] GET /compute/v2.1/servers/1cf67257-a3ee-4cb2-bd74-d382b9d6e903 => generated 1314 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:32:41.901731 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-cf4497ff-31c4-4fef-80e9-0f5856ff31b7 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:41.902937 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-cf4497ff-31c4-4fef-80e9-0f5856ff31b7 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:41.909310 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-cf4497ff-31c4-4fef-80e9-0f5856ff31b7 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:41.909756 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-cf4497ff-31c4-4fef-80e9-0f5856ff31b7 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:41.910523 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-cf4497ff-31c4-4fef-80e9-0f5856ff31b7 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:41.910955 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-cf4497ff-31c4-4fef-80e9-0f5856ff31b7 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:42.093202 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-cf4497ff-31c4-4fef-80e9-0f5856ff31b7 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:42.110161 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-cf4497ff-31c4-4fef-80e9-0f5856ff31b7 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:42.120169 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-cf4497ff-31c4-4fef-80e9-0f5856ff31b7 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:42.120169 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-cf4497ff-31c4-4fef-80e9-0f5856ff31b7 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1808 microversion: 2.20 time: 0.220702 Oct 29 01:32:42.121577 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 325/640] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:32:41 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1808 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:32:42.174417 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-789f74db-306b-4201-995c-d7e87d6dd1c5 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:32:42.183538 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-789f74db-306b-4201-995c-d7e87d6dd1c5 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:42.184121 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-789f74db-306b-4201-995c-d7e87d6dd1c5 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:42.209010 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-789f74db-306b-4201-995c-d7e87d6dd1c5 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Going to try to stop instance {{(pid=116379) force_stop /opt/stack/nova/nova/compute/api.py:2652}} Oct 29 01:32:42.309823 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-0bb037b8-e9de-4c3b-b9c7-493cd6ccc6aa tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:42.311080 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-0bb037b8-e9de-4c3b-b9c7-493cd6ccc6aa tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] [instance: c49107f1-6a48-4184-8bb6-fa2f027193ba] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:42.318181 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-0bb037b8-e9de-4c3b-b9c7-493cd6ccc6aa tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:42.318765 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-0bb037b8-e9de-4c3b-b9c7-493cd6ccc6aa tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:42.322090 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-0bb037b8-e9de-4c3b-b9c7-493cd6ccc6aa tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:42.322090 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-0bb037b8-e9de-4c3b-b9c7-493cd6ccc6aa tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:42.460978 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-789f74db-306b-4201-995c-d7e87d6dd1c5 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action" status: 202 len: 0 microversion: 2.1 time: 0.290824 Oct 29 01:32:42.462402 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 316/641] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:32:42 2021] POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:32:42.490571 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-555f45b7-d51a-4c37-bf48-b7f7228b5fac tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:42.494179 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-555f45b7-d51a-4c37-bf48-b7f7228b5fac tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] [instance: 1cf67257-a3ee-4cb2-bd74-d382b9d6e903] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:42.504551 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-555f45b7-d51a-4c37-bf48-b7f7228b5fac tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:42.505684 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-555f45b7-d51a-4c37-bf48-b7f7228b5fac tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:42.506663 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-555f45b7-d51a-4c37-bf48-b7f7228b5fac tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:42.507303 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-555f45b7-d51a-4c37-bf48-b7f7228b5fac tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:42.735287 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-0bb037b8-e9de-4c3b-b9c7-493cd6ccc6aa tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ad077fd0164d3c8b4db14262186901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa66fedc6704473996d04ffbf8135e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:42.742922 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-0bb037b8-e9de-4c3b-b9c7-493cd6ccc6aa tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] 10.222.0.87 "GET /compute/v2.1/servers/c49107f1-6a48-4184-8bb6-fa2f027193ba" status: 200 len: 1318 microversion: 2.1 time: 0.441012 Oct 29 01:32:42.743639 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 326/642] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:42 2021] GET /compute/v2.1/servers/c49107f1-6a48-4184-8bb6-fa2f027193ba => generated 1318 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:32:42.756946 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-51ad096d-cd30-45ad-9c10-901eb35f586a tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:42.757544 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-51ad096d-cd30-45ad-9c10-901eb35f586a tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:42.764026 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-51ad096d-cd30-45ad-9c10-901eb35f586a tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:42.764466 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-51ad096d-cd30-45ad-9c10-901eb35f586a tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:42.765232 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-51ad096d-cd30-45ad-9c10-901eb35f586a tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:42.765655 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-51ad096d-cd30-45ad-9c10-901eb35f586a tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:42.862869 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-555f45b7-d51a-4c37-bf48-b7f7228b5fac tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd18483ef44e4f83909d856b2ec64366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18626e87dcd742bca0e65ddb87d7b10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:42.873164 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-555f45b7-d51a-4c37-bf48-b7f7228b5fac tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] 10.222.0.87 "GET /compute/v2.1/servers/1cf67257-a3ee-4cb2-bd74-d382b9d6e903" status: 200 len: 1314 microversion: 2.1 time: 0.408133 Oct 29 01:32:42.874130 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 317/643] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:42 2021] GET /compute/v2.1/servers/1cf67257-a3ee-4cb2-bd74-d382b9d6e903 => generated 1314 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:32:42.879721 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-d32cab2b-aee8-495f-8d34-91228f3a6ecc tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:42.888428 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-d32cab2b-aee8-495f-8d34-91228f3a6ecc tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 8daa36f8-7d64-4d9d-94e6-0519848d4a2c] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:42.888852 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d32cab2b-aee8-495f-8d34-91228f3a6ecc tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:42.889508 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d32cab2b-aee8-495f-8d34-91228f3a6ecc tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:42.890471 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d32cab2b-aee8-495f-8d34-91228f3a6ecc tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:42.891181 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d32cab2b-aee8-495f-8d34-91228f3a6ecc tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:42.925075 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-d32cab2b-aee8-495f-8d34-91228f3a6ecc tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 8daa36f8-7d64-4d9d-94e6-0519848d4a2c] Going to try to terminate instance {{(pid=116379) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 29 01:32:43.004005 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-51ad096d-cd30-45ad-9c10-901eb35f586a tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045dda1ff9b44334954c08e63fcd20c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51a2093a0874d52a08f6e25489ba181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:43.012671 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-51ad096d-cd30-45ad-9c10-901eb35f586a tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92" status: 200 len: 1678 microversion: 2.1 time: 0.259151 Oct 29 01:32:43.013377 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 327/644] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:42 2021] GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92 => generated 1678 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:32:43.138532 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-b5439e86-4d4b-4d6b-8bcd-7fe4fec06d8a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:43.138532 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-b5439e86-4d4b-4d6b-8bcd-7fe4fec06d8a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:43.146228 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-b5439e86-4d4b-4d6b-8bcd-7fe4fec06d8a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:43.146604 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-b5439e86-4d4b-4d6b-8bcd-7fe4fec06d8a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:43.147608 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-b5439e86-4d4b-4d6b-8bcd-7fe4fec06d8a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:43.148081 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-b5439e86-4d4b-4d6b-8bcd-7fe4fec06d8a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:43.270578 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-d32cab2b-aee8-495f-8d34-91228f3a6ecc tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "DELETE /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c" status: 204 len: 0 microversion: 2.1 time: 0.394915 Oct 29 01:32:43.271179 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 318/645] 10.222.0.87 () {58 vars in 1238 bytes} [Fri Oct 29 01:32:42 2021] DELETE /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c => generated 0 bytes in 396 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:32:43.278925 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [req-58b0f427-0d22-4233-aa38-15e30e46379e req-793d8195-3de1-442b-a31c-cc39f5e16c14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c49107f1-6a48-4184-8bb6-fa2f027193ba", "tag": "c07b84b3-5be0-4f7b-8bb4-7af5141edcb7"}]} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:32:43.280414 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:32:43.280414 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: warnings.warn(msg) Oct 29 01:32:43.287156 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [req-58b0f427-0d22-4233-aa38-15e30e46379e req-793d8195-3de1-442b-a31c-cc39f5e16c14 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:43.287717 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [req-58b0f427-0d22-4233-aa38-15e30e46379e req-793d8195-3de1-442b-a31c-cc39f5e16c14 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:43.299354 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.compute.server_external_events [req-58b0f427-0d22-4233-aa38-15e30e46379e req-793d8195-3de1-442b-a31c-cc39f5e16c14 service nova] Creating event network-changed:c07b84b3-5be0-4f7b-8bb4-7af5141edcb7 for instance c49107f1-6a48-4184-8bb6-fa2f027193ba on hv-cinder-81398 Oct 29 01:32:43.304474 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [req-58b0f427-0d22-4233-aa38-15e30e46379e req-793d8195-3de1-442b-a31c-cc39f5e16c14 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031959 Oct 29 01:32:43.305355 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 319/646] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Oct 29 01:32:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:32:43.311077 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-21a5341d-674e-4ef0-81c4-12d7548f9a6f tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:43.311816 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-21a5341d-674e-4ef0-81c4-12d7548f9a6f tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 8daa36f8-7d64-4d9d-94e6-0519848d4a2c] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:43.317743 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-21a5341d-674e-4ef0-81c4-12d7548f9a6f tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:43.318191 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-21a5341d-674e-4ef0-81c4-12d7548f9a6f tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:43.318952 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-21a5341d-674e-4ef0-81c4-12d7548f9a6f tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:43.319383 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-21a5341d-674e-4ef0-81c4-12d7548f9a6f tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:43.470783 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-b5439e86-4d4b-4d6b-8bcd-7fe4fec06d8a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:43.479358 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-b5439e86-4d4b-4d6b-8bcd-7fe4fec06d8a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:43.480891 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-b5439e86-4d4b-4d6b-8bcd-7fe4fec06d8a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:43.482077 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-b5439e86-4d4b-4d6b-8bcd-7fe4fec06d8a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1808 microversion: 2.20 time: 0.350163 Oct 29 01:32:43.482950 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 328/647] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:32:43 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1808 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:32:43.647999 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-21a5341d-674e-4ef0-81c4-12d7548f9a6f tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:43.657797 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-21a5341d-674e-4ef0-81c4-12d7548f9a6f tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c" status: 200 len: 1507 microversion: 2.1 time: 0.351067 Oct 29 01:32:43.658641 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 320/648] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:43 2021] GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c => generated 1507 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:32:43.758861 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-a21139ec-ae5c-4af1-b3e0-11e6e6effbef tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:43.759494 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-a21139ec-ae5c-4af1-b3e0-11e6e6effbef tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] [instance: c49107f1-6a48-4184-8bb6-fa2f027193ba] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:43.765662 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a21139ec-ae5c-4af1-b3e0-11e6e6effbef tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:43.766097 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a21139ec-ae5c-4af1-b3e0-11e6e6effbef tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:43.766864 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a21139ec-ae5c-4af1-b3e0-11e6e6effbef tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:43.767290 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a21139ec-ae5c-4af1-b3e0-11e6e6effbef tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:43.891019 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-77ab8e84-bb27-4a8d-827c-d155a29c16f2 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:43.891621 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-77ab8e84-bb27-4a8d-827c-d155a29c16f2 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] [instance: 1cf67257-a3ee-4cb2-bd74-d382b9d6e903] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:43.897793 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-77ab8e84-bb27-4a8d-827c-d155a29c16f2 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:43.898236 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-77ab8e84-bb27-4a8d-827c-d155a29c16f2 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:43.899035 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-77ab8e84-bb27-4a8d-827c-d155a29c16f2 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:43.899463 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-77ab8e84-bb27-4a8d-827c-d155a29c16f2 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:44.106042 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-a21139ec-ae5c-4af1-b3e0-11e6e6effbef tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ad077fd0164d3c8b4db14262186901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa66fedc6704473996d04ffbf8135e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:44.115377 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-a21139ec-ae5c-4af1-b3e0-11e6e6effbef tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] 10.222.0.87 "GET /compute/v2.1/servers/c49107f1-6a48-4184-8bb6-fa2f027193ba" status: 200 len: 1318 microversion: 2.1 time: 0.360089 Oct 29 01:32:44.135691 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 329/649] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:43 2021] GET /compute/v2.1/servers/c49107f1-6a48-4184-8bb6-fa2f027193ba => generated 1318 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:32:44.143619 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-069fda58-eb4f-42ee-b88a-725ff4ce96c8 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:44.143619 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-069fda58-eb4f-42ee-b88a-725ff4ce96c8 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:44.159243 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-069fda58-eb4f-42ee-b88a-725ff4ce96c8 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:44.159614 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-069fda58-eb4f-42ee-b88a-725ff4ce96c8 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:44.160432 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-069fda58-eb4f-42ee-b88a-725ff4ce96c8 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:44.160859 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-069fda58-eb4f-42ee-b88a-725ff4ce96c8 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:44.583978 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-77ab8e84-bb27-4a8d-827c-d155a29c16f2 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd18483ef44e4f83909d856b2ec64366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18626e87dcd742bca0e65ddb87d7b10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:44.592227 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-77ab8e84-bb27-4a8d-827c-d155a29c16f2 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] 10.222.0.87 "GET /compute/v2.1/servers/1cf67257-a3ee-4cb2-bd74-d382b9d6e903" status: 200 len: 1314 microversion: 2.1 time: 0.704922 Oct 29 01:32:44.592810 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 321/650] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:43 2021] GET /compute/v2.1/servers/1cf67257-a3ee-4cb2-bd74-d382b9d6e903 => generated 1314 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:32:44.604550 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [req-df3aa07a-fc13-4157-938e-0068cfa03771 req-581540b9-1748-48e5-a24d-c74d9b871476 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cf67257-a3ee-4cb2-bd74-d382b9d6e903", "name": "network-vif-plugged", "status": "completed", "tag": "df08f389-09bf-4e90-a0eb-f79791090268"}]} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:32:44.606177 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:32:44.606177 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: warnings.warn(msg) Oct 29 01:32:44.624792 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [req-df3aa07a-fc13-4157-938e-0068cfa03771 req-581540b9-1748-48e5-a24d-c74d9b871476 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:44.625415 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [req-df3aa07a-fc13-4157-938e-0068cfa03771 req-581540b9-1748-48e5-a24d-c74d9b871476 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:44.643347 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.compute.server_external_events [req-df3aa07a-fc13-4157-938e-0068cfa03771 req-581540b9-1748-48e5-a24d-c74d9b871476 service nova] Creating event network-vif-plugged:df08f389-09bf-4e90-a0eb-f79791090268 for instance 1cf67257-a3ee-4cb2-bd74-d382b9d6e903 on hv-cinder-81398 Oct 29 01:32:44.657786 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [req-df3aa07a-fc13-4157-938e-0068cfa03771 req-581540b9-1748-48e5-a24d-c74d9b871476 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059621 Oct 29 01:32:44.661031 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 322/651] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Oct 29 01:32:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:32:44.684244 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-8d55d82c-56e8-4af3-8007-76a0dafc1ae6 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:44.685409 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-8d55d82c-56e8-4af3-8007-76a0dafc1ae6 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:44.696620 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-8d55d82c-56e8-4af3-8007-76a0dafc1ae6 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:44.697780 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-8d55d82c-56e8-4af3-8007-76a0dafc1ae6 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:44.699588 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-8d55d82c-56e8-4af3-8007-76a0dafc1ae6 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:44.700543 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-8d55d82c-56e8-4af3-8007-76a0dafc1ae6 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:44.819882 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-069fda58-eb4f-42ee-b88a-725ff4ce96c8 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045dda1ff9b44334954c08e63fcd20c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51a2093a0874d52a08f6e25489ba181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:44.828811 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-069fda58-eb4f-42ee-b88a-725ff4ce96c8 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92" status: 200 len: 1678 microversion: 2.1 time: 0.691789 Oct 29 01:32:44.829870 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 330/652] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:44 2021] GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92 => generated 1678 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:32:44.834533 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-1174f033-06b1-4a26-b1cb-d9018157087c tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:44.835131 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-1174f033-06b1-4a26-b1cb-d9018157087c tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 8daa36f8-7d64-4d9d-94e6-0519848d4a2c] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:44.841022 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-1174f033-06b1-4a26-b1cb-d9018157087c tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:44.841707 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-1174f033-06b1-4a26-b1cb-d9018157087c tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:44.842633 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-1174f033-06b1-4a26-b1cb-d9018157087c tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:44.843220 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-1174f033-06b1-4a26-b1cb-d9018157087c tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:45.296585 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-8d55d82c-56e8-4af3-8007-76a0dafc1ae6 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:45.305072 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-8d55d82c-56e8-4af3-8007-76a0dafc1ae6 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:45.306719 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-8d55d82c-56e8-4af3-8007-76a0dafc1ae6 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:45.307937 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-8d55d82c-56e8-4af3-8007-76a0dafc1ae6 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1808 microversion: 2.20 time: 0.648270 Oct 29 01:32:45.308500 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 323/653] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:32:44 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1808 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:32:45.313619 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-dc445b4f-3967-4ee4-ada9-d988adcc6625 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:45.316622 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-1174f033-06b1-4a26-b1cb-d9018157087c tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:45.323529 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-dc445b4f-3967-4ee4-ada9-d988adcc6625 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] [instance: c49107f1-6a48-4184-8bb6-fa2f027193ba] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:45.325609 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-1174f033-06b1-4a26-b1cb-d9018157087c tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c" status: 200 len: 1507 microversion: 2.1 time: 0.494562 Oct 29 01:32:45.326742 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 331/654] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:44 2021] GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c => generated 1507 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:32:45.331891 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-dc445b4f-3967-4ee4-ada9-d988adcc6625 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:45.331891 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-dc445b4f-3967-4ee4-ada9-d988adcc6625 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:45.331891 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-dc445b4f-3967-4ee4-ada9-d988adcc6625 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:45.332364 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-dc445b4f-3967-4ee4-ada9-d988adcc6625 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:45.609793 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-34852ea0-9f2c-4424-a394-3d0ad12323f7 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:45.610406 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-34852ea0-9f2c-4424-a394-3d0ad12323f7 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] [instance: 1cf67257-a3ee-4cb2-bd74-d382b9d6e903] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:45.616279 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-34852ea0-9f2c-4424-a394-3d0ad12323f7 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:45.616726 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-34852ea0-9f2c-4424-a394-3d0ad12323f7 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:45.617489 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-34852ea0-9f2c-4424-a394-3d0ad12323f7 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:45.617915 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-34852ea0-9f2c-4424-a394-3d0ad12323f7 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:45.732775 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-dc445b4f-3967-4ee4-ada9-d988adcc6625 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ad077fd0164d3c8b4db14262186901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa66fedc6704473996d04ffbf8135e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:45.740013 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-dc445b4f-3967-4ee4-ada9-d988adcc6625 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] 10.222.0.87 "GET /compute/v2.1/servers/c49107f1-6a48-4184-8bb6-fa2f027193ba" status: 200 len: 1318 microversion: 2.1 time: 0.430534 Oct 29 01:32:45.740662 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 324/655] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:45 2021] GET /compute/v2.1/servers/c49107f1-6a48-4184-8bb6-fa2f027193ba => generated 1318 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:32:45.845637 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-87e6a4de-6344-4b56-8019-148b48c6cff1 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:45.846160 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-87e6a4de-6344-4b56-8019-148b48c6cff1 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:45.852394 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-87e6a4de-6344-4b56-8019-148b48c6cff1 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:45.854155 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-87e6a4de-6344-4b56-8019-148b48c6cff1 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:45.854954 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-87e6a4de-6344-4b56-8019-148b48c6cff1 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:45.855389 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-87e6a4de-6344-4b56-8019-148b48c6cff1 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:45.906473 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-34852ea0-9f2c-4424-a394-3d0ad12323f7 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd18483ef44e4f83909d856b2ec64366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18626e87dcd742bca0e65ddb87d7b10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:45.914476 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-34852ea0-9f2c-4424-a394-3d0ad12323f7 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] 10.222.0.87 "GET /compute/v2.1/servers/1cf67257-a3ee-4cb2-bd74-d382b9d6e903" status: 200 len: 1314 microversion: 2.1 time: 0.308374 Oct 29 01:32:45.915035 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 332/656] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:45 2021] GET /compute/v2.1/servers/1cf67257-a3ee-4cb2-bd74-d382b9d6e903 => generated 1314 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:32:46.027001 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-87e6a4de-6344-4b56-8019-148b48c6cff1 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045dda1ff9b44334954c08e63fcd20c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51a2093a0874d52a08f6e25489ba181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:46.039973 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-87e6a4de-6344-4b56-8019-148b48c6cff1 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92" status: 200 len: 1678 microversion: 2.1 time: 0.192628 Oct 29 01:32:46.039973 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 325/657] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:45 2021] GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92 => generated 1678 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:32:46.328090 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-f4b5296f-15e5-4bda-a5c8-2501bf9c53cf tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:46.329570 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-f4b5296f-15e5-4bda-a5c8-2501bf9c53cf tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:46.344867 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-8f84b200-0a64-4a19-b27a-8baefff34fbe tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:46.345932 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-8f84b200-0a64-4a19-b27a-8baefff34fbe tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 8daa36f8-7d64-4d9d-94e6-0519848d4a2c] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:46.358055 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-f4b5296f-15e5-4bda-a5c8-2501bf9c53cf tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:46.360737 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-f4b5296f-15e5-4bda-a5c8-2501bf9c53cf tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:46.361064 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-8f84b200-0a64-4a19-b27a-8baefff34fbe tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:46.361764 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-8f84b200-0a64-4a19-b27a-8baefff34fbe tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:46.363325 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-8f84b200-0a64-4a19-b27a-8baefff34fbe tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:46.363960 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-f4b5296f-15e5-4bda-a5c8-2501bf9c53cf tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:46.364480 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-f4b5296f-15e5-4bda-a5c8-2501bf9c53cf tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:46.365203 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-8f84b200-0a64-4a19-b27a-8baefff34fbe tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:46.737250 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-8f84b200-0a64-4a19-b27a-8baefff34fbe tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:46.746288 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-8f84b200-0a64-4a19-b27a-8baefff34fbe tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c" status: 200 len: 1507 microversion: 2.1 time: 0.406951 Oct 29 01:32:46.752478 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 326/658] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:46 2021] GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c => generated 1507 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:32:46.761432 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-1a610b32-0f83-4f66-9284-0e6d052e1107 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:46.762042 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-1a610b32-0f83-4f66-9284-0e6d052e1107 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] [instance: c49107f1-6a48-4184-8bb6-fa2f027193ba] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:46.782681 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-1a610b32-0f83-4f66-9284-0e6d052e1107 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:46.783129 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-1a610b32-0f83-4f66-9284-0e6d052e1107 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:46.783953 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-1a610b32-0f83-4f66-9284-0e6d052e1107 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:46.784387 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-1a610b32-0f83-4f66-9284-0e6d052e1107 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:46.790784 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-f4b5296f-15e5-4bda-a5c8-2501bf9c53cf tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:46.807387 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-f4b5296f-15e5-4bda-a5c8-2501bf9c53cf tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:46.815960 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-f4b5296f-15e5-4bda-a5c8-2501bf9c53cf tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:46.817531 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-f4b5296f-15e5-4bda-a5c8-2501bf9c53cf tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1808 microversion: 2.20 time: 0.494567 Oct 29 01:32:46.820090 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 333/659] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:32:46 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1808 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:32:46.932669 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-9beb91e6-d5a6-456c-ab74-7ece214cd453 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:46.934046 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-9beb91e6-d5a6-456c-ab74-7ece214cd453 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] [instance: 1cf67257-a3ee-4cb2-bd74-d382b9d6e903] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:46.941177 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-9beb91e6-d5a6-456c-ab74-7ece214cd453 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:46.941850 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-9beb91e6-d5a6-456c-ab74-7ece214cd453 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:46.944144 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-9beb91e6-d5a6-456c-ab74-7ece214cd453 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:46.944801 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-9beb91e6-d5a6-456c-ab74-7ece214cd453 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:47.137264 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-1a610b32-0f83-4f66-9284-0e6d052e1107 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ad077fd0164d3c8b4db14262186901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa66fedc6704473996d04ffbf8135e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:47.247838 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-9beb91e6-d5a6-456c-ab74-7ece214cd453 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd18483ef44e4f83909d856b2ec64366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18626e87dcd742bca0e65ddb87d7b10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:47.262941 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-9beb91e6-d5a6-456c-ab74-7ece214cd453 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] 10.222.0.87 "GET /compute/v2.1/servers/1cf67257-a3ee-4cb2-bd74-d382b9d6e903" status: 200 len: 1314 microversion: 2.1 time: 0.334972 Oct 29 01:32:47.272633 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 334/660] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:46 2021] GET /compute/v2.1/servers/1cf67257-a3ee-4cb2-bd74-d382b9d6e903 => generated 1314 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:32:47.273691 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-1a610b32-0f83-4f66-9284-0e6d052e1107 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] 10.222.0.87 "GET /compute/v2.1/servers/c49107f1-6a48-4184-8bb6-fa2f027193ba" status: 200 len: 1318 microversion: 2.1 time: 0.510238 Oct 29 01:32:47.274839 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 327/661] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:46 2021] GET /compute/v2.1/servers/c49107f1-6a48-4184-8bb6-fa2f027193ba => generated 1318 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:32:47.278709 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-47344338-6b9a-4399-8d7a-d6f98eb2cc1f tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:47.279398 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-47344338-6b9a-4399-8d7a-d6f98eb2cc1f tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:47.286583 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-47344338-6b9a-4399-8d7a-d6f98eb2cc1f tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:47.286806 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-47344338-6b9a-4399-8d7a-d6f98eb2cc1f tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:47.287721 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-47344338-6b9a-4399-8d7a-d6f98eb2cc1f tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:47.288272 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-47344338-6b9a-4399-8d7a-d6f98eb2cc1f tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:47.584306 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-47344338-6b9a-4399-8d7a-d6f98eb2cc1f tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045dda1ff9b44334954c08e63fcd20c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51a2093a0874d52a08f6e25489ba181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:47.598119 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [req-9fbd00f9-71dc-4b6f-8798-50e9d1bb41fd req-267ac02e-bdba-4e9a-b0db-8a8ffbc1a766 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8daa36f8-7d64-4d9d-94e6-0519848d4a2c", "name": "network-vif-deleted", "tag": "8795097b-0746-4ca7-81ba-d053d48c81c2"}]} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:32:47.599989 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-47344338-6b9a-4399-8d7a-d6f98eb2cc1f tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92" status: 200 len: 1678 microversion: 2.1 time: 0.333807 Oct 29 01:32:47.600264 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:32:47.600264 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: warnings.warn(msg) Oct 29 01:32:47.600977 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 335/662] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:47 2021] GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92 => generated 1678 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:32:47.614070 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [req-9fbd00f9-71dc-4b6f-8798-50e9d1bb41fd req-267ac02e-bdba-4e9a-b0db-8a8ffbc1a766 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:47.614508 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [req-9fbd00f9-71dc-4b6f-8798-50e9d1bb41fd req-267ac02e-bdba-4e9a-b0db-8a8ffbc1a766 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:47.627892 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.compute.server_external_events [req-9fbd00f9-71dc-4b6f-8798-50e9d1bb41fd req-267ac02e-bdba-4e9a-b0db-8a8ffbc1a766 service nova] Creating event network-vif-deleted:8795097b-0746-4ca7-81ba-d053d48c81c2 for instance 8daa36f8-7d64-4d9d-94e6-0519848d4a2c on hv-cinder-81398 Oct 29 01:32:47.633122 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [req-9fbd00f9-71dc-4b6f-8798-50e9d1bb41fd req-267ac02e-bdba-4e9a-b0db-8a8ffbc1a766 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039741 Oct 29 01:32:47.633820 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 328/663] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Oct 29 01:32:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:32:47.763275 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-9159864e-69ad-448d-bd20-ab5b0a598db4 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:47.764183 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-9159864e-69ad-448d-bd20-ab5b0a598db4 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 8daa36f8-7d64-4d9d-94e6-0519848d4a2c] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:47.777614 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-9159864e-69ad-448d-bd20-ab5b0a598db4 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:47.778341 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-9159864e-69ad-448d-bd20-ab5b0a598db4 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:47.779297 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-9159864e-69ad-448d-bd20-ab5b0a598db4 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:47.779942 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-9159864e-69ad-448d-bd20-ab5b0a598db4 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:47.848862 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-b615bb36-1ba4-4c90-9029-c6ccf4843842 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:47.850298 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-b615bb36-1ba4-4c90-9029-c6ccf4843842 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:47.859520 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-b615bb36-1ba4-4c90-9029-c6ccf4843842 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:47.860575 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-b615bb36-1ba4-4c90-9029-c6ccf4843842 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:47.860991 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-9159864e-69ad-448d-bd20-ab5b0a598db4 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:47.862320 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-b615bb36-1ba4-4c90-9029-c6ccf4843842 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:47.862927 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-b615bb36-1ba4-4c90-9029-c6ccf4843842 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:47.874479 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-9159864e-69ad-448d-bd20-ab5b0a598db4 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c" status: 200 len: 1293 microversion: 2.1 time: 0.115249 Oct 29 01:32:47.875050 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 336/664] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:47 2021] GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c => generated 1293 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:32:48.019967 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-b615bb36-1ba4-4c90-9029-c6ccf4843842 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:48.031760 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-b615bb36-1ba4-4c90-9029-c6ccf4843842 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:48.032970 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-b615bb36-1ba4-4c90-9029-c6ccf4843842 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:48.034305 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-b615bb36-1ba4-4c90-9029-c6ccf4843842 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1808 microversion: 2.20 time: 0.194987 Oct 29 01:32:48.035077 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 329/665] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:32:47 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1808 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:32:48.280003 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-ec99f5b3-04ae-4eb2-a8ac-7ea0a6466c52 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:48.280609 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-ec99f5b3-04ae-4eb2-a8ac-7ea0a6466c52 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] [instance: 1cf67257-a3ee-4cb2-bd74-d382b9d6e903] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:48.287689 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ec99f5b3-04ae-4eb2-a8ac-7ea0a6466c52 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:48.288172 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ec99f5b3-04ae-4eb2-a8ac-7ea0a6466c52 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:48.289123 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ec99f5b3-04ae-4eb2-a8ac-7ea0a6466c52 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:48.289740 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ec99f5b3-04ae-4eb2-a8ac-7ea0a6466c52 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:48.294256 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-447e72ee-0f16-4846-b4b0-41793aac0e1c tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:48.295876 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-447e72ee-0f16-4846-b4b0-41793aac0e1c tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] [instance: c49107f1-6a48-4184-8bb6-fa2f027193ba] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:48.304156 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-447e72ee-0f16-4846-b4b0-41793aac0e1c tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:48.304850 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-447e72ee-0f16-4846-b4b0-41793aac0e1c tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:48.305999 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-447e72ee-0f16-4846-b4b0-41793aac0e1c tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:48.308221 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-447e72ee-0f16-4846-b4b0-41793aac0e1c tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:48.814526 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-447e72ee-0f16-4846-b4b0-41793aac0e1c tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ad077fd0164d3c8b4db14262186901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa66fedc6704473996d04ffbf8135e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:48.834895 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-447e72ee-0f16-4846-b4b0-41793aac0e1c tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] 10.222.0.87 "GET /compute/v2.1/servers/c49107f1-6a48-4184-8bb6-fa2f027193ba" status: 200 len: 1318 microversion: 2.1 time: 0.532021 Oct 29 01:32:48.834895 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 330/666] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:48 2021] GET /compute/v2.1/servers/c49107f1-6a48-4184-8bb6-fa2f027193ba => generated 1318 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:32:48.834895 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-7d20c8b2-46ee-4c78-84b5-0178db709678 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:48.834895 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-7d20c8b2-46ee-4c78-84b5-0178db709678 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:48.841552 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-ec99f5b3-04ae-4eb2-a8ac-7ea0a6466c52 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd18483ef44e4f83909d856b2ec64366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18626e87dcd742bca0e65ddb87d7b10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:48.846578 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-7d20c8b2-46ee-4c78-84b5-0178db709678 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:48.847518 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-7d20c8b2-46ee-4c78-84b5-0178db709678 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:48.848787 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-7d20c8b2-46ee-4c78-84b5-0178db709678 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:48.849897 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-7d20c8b2-46ee-4c78-84b5-0178db709678 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:48.850435 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-ec99f5b3-04ae-4eb2-a8ac-7ea0a6466c52 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] 10.222.0.87 "GET /compute/v2.1/servers/1cf67257-a3ee-4cb2-bd74-d382b9d6e903" status: 200 len: 1464 microversion: 2.1 time: 0.573910 Oct 29 01:32:48.861084 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 337/667] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:48 2021] GET /compute/v2.1/servers/1cf67257-a3ee-4cb2-bd74-d382b9d6e903 => generated 1464 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:32:48.891215 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-33ccdbec-d793-4977-8c77-176586932904 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:48.891845 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-33ccdbec-d793-4977-8c77-176586932904 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 8daa36f8-7d64-4d9d-94e6-0519848d4a2c] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:48.903753 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-33ccdbec-d793-4977-8c77-176586932904 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:48.904196 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-33ccdbec-d793-4977-8c77-176586932904 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:48.904973 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-33ccdbec-d793-4977-8c77-176586932904 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:48.905401 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-33ccdbec-d793-4977-8c77-176586932904 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:48.957725 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.wsgi [None req-33ccdbec-d793-4977-8c77-176586932904 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] HTTP exception thrown: Instance 8daa36f8-7d64-4d9d-94e6-0519848d4a2c could not be found. Oct 29 01:32:48.958573 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-33ccdbec-d793-4977-8c77-176586932904 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Returning 404 to user: Instance 8daa36f8-7d64-4d9d-94e6-0519848d4a2c could not be found. {{(pid=116378) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:32:48.960418 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-33ccdbec-d793-4977-8c77-176586932904 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c" status: 404 len: 111 microversion: 2.1 time: 0.072848 Oct 29 01:32:48.964907 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 338/668] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:48 2021] GET /compute/v2.1/servers/8daa36f8-7d64-4d9d-94e6-0519848d4a2c => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 01:32:48.969945 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-9831f624-0fc6-4b4e-a193-cca7c4e40833 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:48.970636 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-9831f624-0fc6-4b4e-a193-cca7c4e40833 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] [instance: 1cf67257-a3ee-4cb2-bd74-d382b9d6e903] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:48.977030 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-9831f624-0fc6-4b4e-a193-cca7c4e40833 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:48.977667 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-9831f624-0fc6-4b4e-a193-cca7c4e40833 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:48.978696 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-9831f624-0fc6-4b4e-a193-cca7c4e40833 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:48.979308 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-9831f624-0fc6-4b4e-a193-cca7c4e40833 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:49.008188 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-9831f624-0fc6-4b4e-a193-cca7c4e40833 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] [instance: 1cf67257-a3ee-4cb2-bd74-d382b9d6e903] Going to try to terminate instance {{(pid=116378) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 29 01:32:49.042047 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-7d20c8b2-46ee-4c78-84b5-0178db709678 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045dda1ff9b44334954c08e63fcd20c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51a2093a0874d52a08f6e25489ba181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:49.049509 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-7d20c8b2-46ee-4c78-84b5-0178db709678 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92" status: 200 len: 1678 microversion: 2.1 time: 0.222287 Oct 29 01:32:49.050098 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 331/669] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:48 2021] GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92 => generated 1678 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:32:49.059229 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-244d37c7-115f-4c70-bb38-59ff99f6386b tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:49.059229 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-244d37c7-115f-4c70-bb38-59ff99f6386b tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:49.060910 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-244d37c7-115f-4c70-bb38-59ff99f6386b tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:49.061353 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-244d37c7-115f-4c70-bb38-59ff99f6386b tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:49.062170 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-244d37c7-115f-4c70-bb38-59ff99f6386b tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:49.062600 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-244d37c7-115f-4c70-bb38-59ff99f6386b tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:49.087229 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-244d37c7-115f-4c70-bb38-59ff99f6386b tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Going to try to terminate instance {{(pid=116379) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 29 01:32:49.435251 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-9831f624-0fc6-4b4e-a193-cca7c4e40833 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] 10.222.0.87 "DELETE /compute/v2.1/servers/1cf67257-a3ee-4cb2-bd74-d382b9d6e903" status: 204 len: 0 microversion: 2.1 time: 0.468735 Oct 29 01:32:49.435858 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 339/670] 10.222.0.87 () {58 vars in 1238 bytes} [Fri Oct 29 01:32:48 2021] DELETE /compute/v2.1/servers/1cf67257-a3ee-4cb2-bd74-d382b9d6e903 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:32:49.440871 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-1603c2e8-e130-4431-b4e4-24ca35f10f8d tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:49.444745 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-1603c2e8-e130-4431-b4e4-24ca35f10f8d tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:49.448158 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-1603c2e8-e130-4431-b4e4-24ca35f10f8d tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:49.448493 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-1603c2e8-e130-4431-b4e4-24ca35f10f8d tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:49.449245 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-1603c2e8-e130-4431-b4e4-24ca35f10f8d tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:49.449670 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-1603c2e8-e130-4431-b4e4-24ca35f10f8d tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:49.465942 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-244d37c7-115f-4c70-bb38-59ff99f6386b tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "DELETE /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca" status: 204 len: 0 microversion: 2.1 time: 0.414503 Oct 29 01:32:49.466833 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 332/671] 10.222.0.87 () {58 vars in 1238 bytes} [Fri Oct 29 01:32:49 2021] DELETE /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca => generated 0 bytes in 416 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:32:49.472231 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-f58c1a99-dcb8-49d7-bbd2-9d2ca64285b0 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:49.472994 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-f58c1a99-dcb8-49d7-bbd2-9d2ca64285b0 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] [instance: 1cf67257-a3ee-4cb2-bd74-d382b9d6e903] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:49.479308 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-f58c1a99-dcb8-49d7-bbd2-9d2ca64285b0 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:49.479806 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-f58c1a99-dcb8-49d7-bbd2-9d2ca64285b0 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:49.480942 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-f58c1a99-dcb8-49d7-bbd2-9d2ca64285b0 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:49.481373 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-f58c1a99-dcb8-49d7-bbd2-9d2ca64285b0 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:49.630409 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-1603c2e8-e130-4431-b4e4-24ca35f10f8d tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:49.641262 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-1603c2e8-e130-4431-b4e4-24ca35f10f8d tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:49.642880 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-1603c2e8-e130-4431-b4e4-24ca35f10f8d tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:49.644652 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-1603c2e8-e130-4431-b4e4-24ca35f10f8d tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1808 microversion: 2.20 time: 0.207725 Oct 29 01:32:49.645268 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 340/672] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:32:49 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1808 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:32:49.657687 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-e4cf74d8-2e50-4257-b090-387db1f6f8c2 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:49.658484 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-e4cf74d8-2e50-4257-b090-387db1f6f8c2 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:49.661755 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-f58c1a99-dcb8-49d7-bbd2-9d2ca64285b0 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd18483ef44e4f83909d856b2ec64366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18626e87dcd742bca0e65ddb87d7b10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:49.664666 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-e4cf74d8-2e50-4257-b090-387db1f6f8c2 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:49.665109 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-e4cf74d8-2e50-4257-b090-387db1f6f8c2 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:49.666453 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-e4cf74d8-2e50-4257-b090-387db1f6f8c2 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:49.667201 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-e4cf74d8-2e50-4257-b090-387db1f6f8c2 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:49.671003 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-f58c1a99-dcb8-49d7-bbd2-9d2ca64285b0 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] 10.222.0.87 "GET /compute/v2.1/servers/1cf67257-a3ee-4cb2-bd74-d382b9d6e903" status: 200 len: 1470 microversion: 2.1 time: 0.203024 Oct 29 01:32:49.675772 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 333/673] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:49 2021] GET /compute/v2.1/servers/1cf67257-a3ee-4cb2-bd74-d382b9d6e903 => generated 1470 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:32:49.793451 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-e4cf74d8-2e50-4257-b090-387db1f6f8c2 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:49.800771 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-e4cf74d8-2e50-4257-b090-387db1f6f8c2 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca" status: 200 len: 1520 microversion: 2.1 time: 0.154380 Oct 29 01:32:49.803415 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 341/674] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:49 2021] GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:32:49.842916 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-0fec1964-d31c-4cca-adab-ea2a03dc49a6 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:49.843516 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-0fec1964-d31c-4cca-adab-ea2a03dc49a6 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] [instance: c49107f1-6a48-4184-8bb6-fa2f027193ba] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:49.850229 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-0fec1964-d31c-4cca-adab-ea2a03dc49a6 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:49.850868 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-0fec1964-d31c-4cca-adab-ea2a03dc49a6 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:49.851514 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-0fec1964-d31c-4cca-adab-ea2a03dc49a6 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:49.852163 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-0fec1964-d31c-4cca-adab-ea2a03dc49a6 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:49.988039 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-0fec1964-d31c-4cca-adab-ea2a03dc49a6 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ad077fd0164d3c8b4db14262186901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa66fedc6704473996d04ffbf8135e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:49.996026 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-0fec1964-d31c-4cca-adab-ea2a03dc49a6 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] 10.222.0.87 "GET /compute/v2.1/servers/c49107f1-6a48-4184-8bb6-fa2f027193ba" status: 200 len: 1318 microversion: 2.1 time: 0.156766 Oct 29 01:32:49.996689 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 334/675] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:49 2021] GET /compute/v2.1/servers/c49107f1-6a48-4184-8bb6-fa2f027193ba => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:32:50.067588 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-6904b286-e92a-45bc-8aa6-21ff7fe1b8be tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:50.067588 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-6904b286-e92a-45bc-8aa6-21ff7fe1b8be tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:50.073739 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-6904b286-e92a-45bc-8aa6-21ff7fe1b8be tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:50.074182 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-6904b286-e92a-45bc-8aa6-21ff7fe1b8be tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:50.074955 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-6904b286-e92a-45bc-8aa6-21ff7fe1b8be tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:50.075383 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-6904b286-e92a-45bc-8aa6-21ff7fe1b8be tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:50.202136 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-6904b286-e92a-45bc-8aa6-21ff7fe1b8be tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045dda1ff9b44334954c08e63fcd20c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51a2093a0874d52a08f6e25489ba181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:50.210445 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-6904b286-e92a-45bc-8aa6-21ff7fe1b8be tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92" status: 200 len: 1678 microversion: 2.1 time: 0.147625 Oct 29 01:32:50.211715 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 342/676] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:50 2021] GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92 => generated 1678 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:32:50.577914 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [req-d947432e-af17-4a9f-9a83-c0c79ae103e9 req-50ffba10-349d-461f-bf96-86958ad714fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f64f5ebf-8af1-4507-849e-b7d8e33979ae", "name": "network-vif-plugged", "status": "completed", "tag": "01153800-bf44-4376-854e-aec24743a4d7"}]} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:32:50.581709 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:32:50.581709 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: warnings.warn(msg) Oct 29 01:32:50.592369 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [req-d947432e-af17-4a9f-9a83-c0c79ae103e9 req-50ffba10-349d-461f-bf96-86958ad714fb service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:50.592893 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [req-d947432e-af17-4a9f-9a83-c0c79ae103e9 req-50ffba10-349d-461f-bf96-86958ad714fb service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:50.607279 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.compute.server_external_events [req-d947432e-af17-4a9f-9a83-c0c79ae103e9 req-50ffba10-349d-461f-bf96-86958ad714fb service nova] Creating event network-vif-plugged:01153800-bf44-4376-854e-aec24743a4d7 for instance f64f5ebf-8af1-4507-849e-b7d8e33979ae on hv-cinder-81398 Oct 29 01:32:50.614113 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [req-d947432e-af17-4a9f-9a83-c0c79ae103e9 req-50ffba10-349d-461f-bf96-86958ad714fb service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040010 Oct 29 01:32:50.615760 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 335/677] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Oct 29 01:32:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:32:50.664240 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-45654934-f782-424d-8790-60aa64447b28 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:50.665122 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-45654934-f782-424d-8790-60aa64447b28 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:50.677438 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-45654934-f782-424d-8790-60aa64447b28 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:50.677897 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-45654934-f782-424d-8790-60aa64447b28 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:50.678688 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-45654934-f782-424d-8790-60aa64447b28 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:50.679126 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-45654934-f782-424d-8790-60aa64447b28 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:50.692168 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-176ce065-0a1d-420a-bd9c-3073f1e523dd tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:50.693909 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-176ce065-0a1d-420a-bd9c-3073f1e523dd tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] [instance: 1cf67257-a3ee-4cb2-bd74-d382b9d6e903] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:50.702165 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-176ce065-0a1d-420a-bd9c-3073f1e523dd tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:50.703173 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-176ce065-0a1d-420a-bd9c-3073f1e523dd tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:50.704184 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-176ce065-0a1d-420a-bd9c-3073f1e523dd tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:50.704800 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-176ce065-0a1d-420a-bd9c-3073f1e523dd tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:50.885536 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-45654934-f782-424d-8790-60aa64447b28 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:50.894649 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-45654934-f782-424d-8790-60aa64447b28 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:50.896177 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-45654934-f782-424d-8790-60aa64447b28 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:50.897421 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-45654934-f782-424d-8790-60aa64447b28 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1808 microversion: 2.20 time: 0.238861 Oct 29 01:32:50.898574 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 343/678] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:32:50 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1808 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:32:50.900837 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-176ce065-0a1d-420a-bd9c-3073f1e523dd tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd18483ef44e4f83909d856b2ec64366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18626e87dcd742bca0e65ddb87d7b10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:50.909665 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-15baf7fb-d399-42b6-bbe6-6af72fbdc501 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:50.910579 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-176ce065-0a1d-420a-bd9c-3073f1e523dd tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] 10.222.0.87 "GET /compute/v2.1/servers/1cf67257-a3ee-4cb2-bd74-d382b9d6e903" status: 200 len: 1470 microversion: 2.1 time: 0.223957 Oct 29 01:32:50.911162 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 336/679] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:50 2021] GET /compute/v2.1/servers/1cf67257-a3ee-4cb2-bd74-d382b9d6e903 => generated 1470 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:32:50.911988 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-15baf7fb-d399-42b6-bbe6-6af72fbdc501 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:50.918783 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-15baf7fb-d399-42b6-bbe6-6af72fbdc501 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:50.919549 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-15baf7fb-d399-42b6-bbe6-6af72fbdc501 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:50.924211 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-15baf7fb-d399-42b6-bbe6-6af72fbdc501 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:50.924603 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-15baf7fb-d399-42b6-bbe6-6af72fbdc501 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:51.018030 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-96e481a6-f539-49a0-b43d-274e066e98b8 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:51.019010 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-96e481a6-f539-49a0-b43d-274e066e98b8 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] [instance: c49107f1-6a48-4184-8bb6-fa2f027193ba] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:51.034269 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-96e481a6-f539-49a0-b43d-274e066e98b8 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:51.036927 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-96e481a6-f539-49a0-b43d-274e066e98b8 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:51.036927 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-96e481a6-f539-49a0-b43d-274e066e98b8 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:51.036927 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-96e481a6-f539-49a0-b43d-274e066e98b8 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:51.084008 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-15baf7fb-d399-42b6-bbe6-6af72fbdc501 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:51.094026 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-15baf7fb-d399-42b6-bbe6-6af72fbdc501 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca" status: 200 len: 1520 microversion: 2.1 time: 0.193977 Oct 29 01:32:51.094556 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 344/680] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:50 2021] GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca => generated 1520 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:32:51.227320 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-102eb789-5764-4f5c-833c-ec2be957db26 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:51.228006 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-102eb789-5764-4f5c-833c-ec2be957db26 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:51.236222 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-102eb789-5764-4f5c-833c-ec2be957db26 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:51.241590 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-102eb789-5764-4f5c-833c-ec2be957db26 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:51.241999 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-96e481a6-f539-49a0-b43d-274e066e98b8 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ad077fd0164d3c8b4db14262186901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa66fedc6704473996d04ffbf8135e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:51.243001 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-102eb789-5764-4f5c-833c-ec2be957db26 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:51.244222 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-102eb789-5764-4f5c-833c-ec2be957db26 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:51.252721 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-96e481a6-f539-49a0-b43d-274e066e98b8 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] 10.222.0.87 "GET /compute/v2.1/servers/c49107f1-6a48-4184-8bb6-fa2f027193ba" status: 200 len: 1318 microversion: 2.1 time: 0.243597 Oct 29 01:32:51.253304 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 337/681] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:51 2021] GET /compute/v2.1/servers/c49107f1-6a48-4184-8bb6-fa2f027193ba => generated 1318 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:32:51.486168 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-102eb789-5764-4f5c-833c-ec2be957db26 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045dda1ff9b44334954c08e63fcd20c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51a2093a0874d52a08f6e25489ba181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:51.496394 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-102eb789-5764-4f5c-833c-ec2be957db26 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92" status: 200 len: 1678 microversion: 2.1 time: 0.272774 Oct 29 01:32:51.498286 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 345/682] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:51 2021] GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92 => generated 1678 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:32:51.916544 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-7481643c-82f5-4d9e-9719-185ab85b7f2f tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:51.917145 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-7481643c-82f5-4d9e-9719-185ab85b7f2f tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:51.923247 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-7481643c-82f5-4d9e-9719-185ab85b7f2f tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:51.923688 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-7481643c-82f5-4d9e-9719-185ab85b7f2f tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:51.924483 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-7481643c-82f5-4d9e-9719-185ab85b7f2f tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:51.924904 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-7481643c-82f5-4d9e-9719-185ab85b7f2f tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:51.931872 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-60e9370e-f851-4ff1-bdb1-cfbb5942cc50 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:51.932215 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-60e9370e-f851-4ff1-bdb1-cfbb5942cc50 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] [instance: 1cf67257-a3ee-4cb2-bd74-d382b9d6e903] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:51.958561 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-60e9370e-f851-4ff1-bdb1-cfbb5942cc50 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:51.959439 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-60e9370e-f851-4ff1-bdb1-cfbb5942cc50 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:51.963064 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-60e9370e-f851-4ff1-bdb1-cfbb5942cc50 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:51.964540 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-60e9370e-f851-4ff1-bdb1-cfbb5942cc50 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:52.114305 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-60e9370e-f851-4ff1-bdb1-cfbb5942cc50 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd18483ef44e4f83909d856b2ec64366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18626e87dcd742bca0e65ddb87d7b10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:52.124776 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-60e9370e-f851-4ff1-bdb1-cfbb5942cc50 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] 10.222.0.87 "GET /compute/v2.1/servers/1cf67257-a3ee-4cb2-bd74-d382b9d6e903" status: 200 len: 1428 microversion: 2.1 time: 0.198324 Oct 29 01:32:52.125534 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 346/683] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:51 2021] GET /compute/v2.1/servers/1cf67257-a3ee-4cb2-bd74-d382b9d6e903 => generated 1428 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:32:52.141793 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [req-3647d1d5-56d3-4c50-84c4-23d9c13a0098 req-f2547dff-316d-4a03-a9dd-9f5bd31f046d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cf67257-a3ee-4cb2-bd74-d382b9d6e903", "name": "network-vif-deleted", "tag": "df08f389-09bf-4e90-a0eb-f79791090268"}]} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:32:52.150586 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:32:52.150586 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: warnings.warn(msg) Oct 29 01:32:52.170644 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [req-3647d1d5-56d3-4c50-84c4-23d9c13a0098 req-f2547dff-316d-4a03-a9dd-9f5bd31f046d service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:52.171343 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [req-3647d1d5-56d3-4c50-84c4-23d9c13a0098 req-f2547dff-316d-4a03-a9dd-9f5bd31f046d service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:52.193453 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.compute.server_external_events [req-3647d1d5-56d3-4c50-84c4-23d9c13a0098 req-f2547dff-316d-4a03-a9dd-9f5bd31f046d service nova] Creating event network-vif-deleted:df08f389-09bf-4e90-a0eb-f79791090268 for instance 1cf67257-a3ee-4cb2-bd74-d382b9d6e903 on hv-cinder-81398 Oct 29 01:32:52.201926 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-7481643c-82f5-4d9e-9719-185ab85b7f2f tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:52.219160 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [req-3647d1d5-56d3-4c50-84c4-23d9c13a0098 req-f2547dff-316d-4a03-a9dd-9f5bd31f046d service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091918 Oct 29 01:32:52.220155 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 347/684] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Oct 29 01:32:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:32:52.235197 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-152933d5-4f16-4919-bfe1-9ed27da90be4 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:52.235197 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-152933d5-4f16-4919-bfe1-9ed27da90be4 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:52.235417 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-7481643c-82f5-4d9e-9719-185ab85b7f2f tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:52.236061 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-152933d5-4f16-4919-bfe1-9ed27da90be4 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:52.236698 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-152933d5-4f16-4919-bfe1-9ed27da90be4 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:52.237045 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-7481643c-82f5-4d9e-9719-185ab85b7f2f tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:52.238003 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-152933d5-4f16-4919-bfe1-9ed27da90be4 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:52.238625 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-152933d5-4f16-4919-bfe1-9ed27da90be4 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:52.244188 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-7481643c-82f5-4d9e-9719-185ab85b7f2f tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1808 microversion: 2.20 time: 0.331946 Oct 29 01:32:52.256437 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 338/685] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:32:51 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1808 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:32:52.278078 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-d374095a-5763-4f96-aecd-ebd19853d602 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:52.278949 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-d374095a-5763-4f96-aecd-ebd19853d602 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] [instance: c49107f1-6a48-4184-8bb6-fa2f027193ba] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:52.285363 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d374095a-5763-4f96-aecd-ebd19853d602 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:52.285826 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d374095a-5763-4f96-aecd-ebd19853d602 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:52.286602 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d374095a-5763-4f96-aecd-ebd19853d602 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:52.287034 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d374095a-5763-4f96-aecd-ebd19853d602 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:52.434762 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-152933d5-4f16-4919-bfe1-9ed27da90be4 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:52.442121 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-152933d5-4f16-4919-bfe1-9ed27da90be4 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca" status: 200 len: 1520 microversion: 2.1 time: 0.220801 Oct 29 01:32:52.442697 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 348/686] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:52 2021] GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca => generated 1520 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:32:52.499564 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-d374095a-5763-4f96-aecd-ebd19853d602 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ad077fd0164d3c8b4db14262186901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa66fedc6704473996d04ffbf8135e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:52.499564 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-d374095a-5763-4f96-aecd-ebd19853d602 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] 10.222.0.87 "GET /compute/v2.1/servers/c49107f1-6a48-4184-8bb6-fa2f027193ba" status: 200 len: 1318 microversion: 2.1 time: 0.218277 Oct 29 01:32:52.499564 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 339/687] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:52 2021] GET /compute/v2.1/servers/c49107f1-6a48-4184-8bb6-fa2f027193ba => generated 1318 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:32:52.567193 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-7f5de739-5cee-48d3-b875-26fd463d521a tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:52.568384 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-7f5de739-5cee-48d3-b875-26fd463d521a tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:52.575400 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-7f5de739-5cee-48d3-b875-26fd463d521a tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:52.575976 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-7f5de739-5cee-48d3-b875-26fd463d521a tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:52.577157 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-7f5de739-5cee-48d3-b875-26fd463d521a tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:52.577768 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-7f5de739-5cee-48d3-b875-26fd463d521a tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:52.658295 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [req-192a4d17-4d49-4594-8e2b-fc6a2a36a121 req-4ce507c5-62cd-4aec-9e69-bb3dc6c66577 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c49107f1-6a48-4184-8bb6-fa2f027193ba", "name": "network-vif-plugged", "status": "completed", "tag": "c07b84b3-5be0-4f7b-8bb4-7af5141edcb7"}]} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:32:52.660040 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:32:52.660040 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: warnings.warn(msg) Oct 29 01:32:52.668403 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [req-192a4d17-4d49-4594-8e2b-fc6a2a36a121 req-4ce507c5-62cd-4aec-9e69-bb3dc6c66577 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:52.668972 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [req-192a4d17-4d49-4594-8e2b-fc6a2a36a121 req-4ce507c5-62cd-4aec-9e69-bb3dc6c66577 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:52.680977 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.compute.server_external_events [req-192a4d17-4d49-4594-8e2b-fc6a2a36a121 req-4ce507c5-62cd-4aec-9e69-bb3dc6c66577 service nova] Creating event network-vif-plugged:c07b84b3-5be0-4f7b-8bb4-7af5141edcb7 for instance c49107f1-6a48-4184-8bb6-fa2f027193ba on hv-cinder-81398 Oct 29 01:32:52.690024 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [req-192a4d17-4d49-4594-8e2b-fc6a2a36a121 req-4ce507c5-62cd-4aec-9e69-bb3dc6c66577 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035154 Oct 29 01:32:52.690843 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 340/688] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Oct 29 01:32:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:32:52.745864 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-7f5de739-5cee-48d3-b875-26fd463d521a tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045dda1ff9b44334954c08e63fcd20c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51a2093a0874d52a08f6e25489ba181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:52.753491 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-7f5de739-5cee-48d3-b875-26fd463d521a tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92" status: 200 len: 1678 microversion: 2.1 time: 0.189873 Oct 29 01:32:52.763425 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 349/689] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:52 2021] GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92 => generated 1678 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:32:53.151654 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-13f61755-9338-496f-bb35-8ca0581103d1 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:53.154523 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-13f61755-9338-496f-bb35-8ca0581103d1 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] [instance: 1cf67257-a3ee-4cb2-bd74-d382b9d6e903] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:53.198331 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-13f61755-9338-496f-bb35-8ca0581103d1 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:53.199270 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-13f61755-9338-496f-bb35-8ca0581103d1 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:53.202144 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-13f61755-9338-496f-bb35-8ca0581103d1 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:53.206098 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-13f61755-9338-496f-bb35-8ca0581103d1 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:53.267969 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-e2c01996-23f2-4bad-aa84-024f2b059d52 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:53.269426 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-e2c01996-23f2-4bad-aa84-024f2b059d52 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:53.288092 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-e2c01996-23f2-4bad-aa84-024f2b059d52 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:53.299904 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-e2c01996-23f2-4bad-aa84-024f2b059d52 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:53.301166 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-e2c01996-23f2-4bad-aa84-024f2b059d52 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:53.301612 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-e2c01996-23f2-4bad-aa84-024f2b059d52 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:53.334348 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-13f61755-9338-496f-bb35-8ca0581103d1 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:53.341007 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-13f61755-9338-496f-bb35-8ca0581103d1 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:53.342081 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.objects.instance [None req-13f61755-9338-496f-bb35-8ca0581103d1 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lazy-loading 'fault' on Instance uuid 1cf67257-a3ee-4cb2-bd74-d382b9d6e903 {{(pid=116379) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 01:32:53.420695 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-13f61755-9338-496f-bb35-8ca0581103d1 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd18483ef44e4f83909d856b2ec64366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18626e87dcd742bca0e65ddb87d7b10b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:53.428546 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-13f61755-9338-496f-bb35-8ca0581103d1 tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] 10.222.0.87 "GET /compute/v2.1/servers/1cf67257-a3ee-4cb2-bd74-d382b9d6e903" status: 200 len: 1304 microversion: 2.1 time: 0.288377 Oct 29 01:32:53.432099 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 341/690] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:53 2021] GET /compute/v2.1/servers/1cf67257-a3ee-4cb2-bd74-d382b9d6e903 => generated 1304 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:32:53.461409 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-7efdeea9-b6c6-4f88-b613-0f2f666d1bfd tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:53.463434 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-7efdeea9-b6c6-4f88-b613-0f2f666d1bfd tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:53.474274 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-7efdeea9-b6c6-4f88-b613-0f2f666d1bfd tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:53.475111 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-7efdeea9-b6c6-4f88-b613-0f2f666d1bfd tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:53.476826 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-7efdeea9-b6c6-4f88-b613-0f2f666d1bfd tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:53.477479 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-7efdeea9-b6c6-4f88-b613-0f2f666d1bfd tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:53.636686 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-e2c01996-23f2-4bad-aa84-024f2b059d52 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:53.652801 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-e2c01996-23f2-4bad-aa84-024f2b059d52 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:53.654016 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-e2c01996-23f2-4bad-aa84-024f2b059d52 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:53.655276 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-e2c01996-23f2-4bad-aa84-024f2b059d52 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1808 microversion: 2.20 time: 0.393789 Oct 29 01:32:53.656824 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 350/691] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:32:53 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1808 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:32:53.661701 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-97379234-7697-4d5e-9916-6f1af71e1898 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:53.662480 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-97379234-7697-4d5e-9916-6f1af71e1898 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] [instance: c49107f1-6a48-4184-8bb6-fa2f027193ba] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:53.674011 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-97379234-7697-4d5e-9916-6f1af71e1898 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:53.674729 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-97379234-7697-4d5e-9916-6f1af71e1898 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:53.675808 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-97379234-7697-4d5e-9916-6f1af71e1898 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:53.681155 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-97379234-7697-4d5e-9916-6f1af71e1898 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:53.735849 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-7efdeea9-b6c6-4f88-b613-0f2f666d1bfd tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:53.749342 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-7efdeea9-b6c6-4f88-b613-0f2f666d1bfd tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca" status: 200 len: 1520 microversion: 2.1 time: 0.292805 Oct 29 01:32:53.749929 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 342/692] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:53 2021] GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca => generated 1520 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:32:53.774250 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-253ad2ad-2ed5-43a2-a144-7c6cfcff28d0 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:53.789046 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-253ad2ad-2ed5-43a2-a144-7c6cfcff28d0 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:53.796160 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-253ad2ad-2ed5-43a2-a144-7c6cfcff28d0 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:53.796853 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-253ad2ad-2ed5-43a2-a144-7c6cfcff28d0 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:53.797805 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-253ad2ad-2ed5-43a2-a144-7c6cfcff28d0 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:53.798391 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-253ad2ad-2ed5-43a2-a144-7c6cfcff28d0 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:54.015483 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-97379234-7697-4d5e-9916-6f1af71e1898 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ad077fd0164d3c8b4db14262186901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa66fedc6704473996d04ffbf8135e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:54.025726 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-97379234-7697-4d5e-9916-6f1af71e1898 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] 10.222.0.87 "GET /compute/v2.1/servers/c49107f1-6a48-4184-8bb6-fa2f027193ba" status: 200 len: 1318 microversion: 2.1 time: 0.366982 Oct 29 01:32:54.026521 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 351/693] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:53 2021] GET /compute/v2.1/servers/c49107f1-6a48-4184-8bb6-fa2f027193ba => generated 1318 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:32:54.076900 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-253ad2ad-2ed5-43a2-a144-7c6cfcff28d0 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045dda1ff9b44334954c08e63fcd20c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51a2093a0874d52a08f6e25489ba181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:54.085986 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-253ad2ad-2ed5-43a2-a144-7c6cfcff28d0 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92" status: 200 len: 1655 microversion: 2.1 time: 0.318805 Oct 29 01:32:54.086812 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 343/694] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:53 2021] GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92 => generated 1655 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:32:54.107131 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-2e9c3bfa-26db-48cd-93e2-7424adf5323c tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:32:54.124134 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-2e9c3bfa-26db-48cd-93e2-7424adf5323c tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:54.138654 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-2e9c3bfa-26db-48cd-93e2-7424adf5323c tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:54.253525 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-2e9c3bfa-26db-48cd-93e2-7424adf5323c tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Going to try to start instance {{(pid=116378) start /opt/stack/nova/nova/compute/api.py:2675}} Oct 29 01:32:54.459800 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-452daa49-9da4-41e7-931b-8fb61fe19dde tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:54.460637 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-452daa49-9da4-41e7-931b-8fb61fe19dde tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] [instance: 1cf67257-a3ee-4cb2-bd74-d382b9d6e903] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:54.478869 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-452daa49-9da4-41e7-931b-8fb61fe19dde tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:54.479503 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-452daa49-9da4-41e7-931b-8fb61fe19dde tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:54.484691 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-452daa49-9da4-41e7-931b-8fb61fe19dde tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:54.485568 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-452daa49-9da4-41e7-931b-8fb61fe19dde tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:54.517168 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.wsgi [None req-452daa49-9da4-41e7-931b-8fb61fe19dde tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] HTTP exception thrown: Instance 1cf67257-a3ee-4cb2-bd74-d382b9d6e903 could not be found. Oct 29 01:32:54.518273 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-452daa49-9da4-41e7-931b-8fb61fe19dde tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] Returning 404 to user: Instance 1cf67257-a3ee-4cb2-bd74-d382b9d6e903 could not be found. {{(pid=116379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:32:54.519411 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-452daa49-9da4-41e7-931b-8fb61fe19dde tempest-VolumesNegativeTest-776164936 tempest-VolumesNegativeTest-776164936-project] 10.222.0.87 "GET /compute/v2.1/servers/1cf67257-a3ee-4cb2-bd74-d382b9d6e903" status: 404 len: 111 microversion: 2.1 time: 0.064910 Oct 29 01:32:54.520747 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 344/695] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:54 2021] GET /compute/v2.1/servers/1cf67257-a3ee-4cb2-bd74-d382b9d6e903 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 01:32:54.521506 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-2e9c3bfa-26db-48cd-93e2-7424adf5323c tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action" status: 202 len: 0 microversion: 2.1 time: 0.418067 Oct 29 01:32:54.522375 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 352/696] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:32:54 2021] POST /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/action => generated 0 bytes in 420 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:32:54.553711 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-da736819-01f8-426b-8dbb-dd4d3e81d8d6 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:54.559670 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-da736819-01f8-426b-8dbb-dd4d3e81d8d6 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:54.583705 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-da736819-01f8-426b-8dbb-dd4d3e81d8d6 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:54.584713 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-da736819-01f8-426b-8dbb-dd4d3e81d8d6 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:54.585709 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-da736819-01f8-426b-8dbb-dd4d3e81d8d6 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:54.589309 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-da736819-01f8-426b-8dbb-dd4d3e81d8d6 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:54.683188 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-d2f26080-24f3-4986-a099-1b513552493c tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:54.685217 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-d2f26080-24f3-4986-a099-1b513552493c tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:54.696085 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-d2f26080-24f3-4986-a099-1b513552493c tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:54.697475 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-d2f26080-24f3-4986-a099-1b513552493c tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:54.699471 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-d2f26080-24f3-4986-a099-1b513552493c tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:54.705829 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-d2f26080-24f3-4986-a099-1b513552493c tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:54.935773 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-da736819-01f8-426b-8dbb-dd4d3e81d8d6 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045dda1ff9b44334954c08e63fcd20c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51a2093a0874d52a08f6e25489ba181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:54.951447 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-da736819-01f8-426b-8dbb-dd4d3e81d8d6 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92" status: 200 len: 1664 microversion: 2.1 time: 0.406320 Oct 29 01:32:54.952223 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 345/697] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:54 2021] GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92 => generated 1664 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:32:54.957500 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-0716124c-1904-4ef2-a1a4-102c2880141c tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:54.964446 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-0716124c-1904-4ef2-a1a4-102c2880141c tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:54.976872 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-0716124c-1904-4ef2-a1a4-102c2880141c tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:54.984274 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-0716124c-1904-4ef2-a1a4-102c2880141c tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:54.984274 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-0716124c-1904-4ef2-a1a4-102c2880141c tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:54.984274 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-0716124c-1904-4ef2-a1a4-102c2880141c tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:55.268967 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-d2f26080-24f3-4986-a099-1b513552493c tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:55.281525 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-d2f26080-24f3-4986-a099-1b513552493c tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:55.286431 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-d2f26080-24f3-4986-a099-1b513552493c tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:55.289642 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-d2f26080-24f3-4986-a099-1b513552493c tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1808 microversion: 2.20 time: 0.619223 Oct 29 01:32:55.290488 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 353/698] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:32:54 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1808 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:32:55.300253 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-91571164-cde3-42e3-814f-29e6942d4b6e tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:55.302074 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-91571164-cde3-42e3-814f-29e6942d4b6e tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] [instance: c49107f1-6a48-4184-8bb6-fa2f027193ba] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:55.310418 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-91571164-cde3-42e3-814f-29e6942d4b6e tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:55.311034 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-91571164-cde3-42e3-814f-29e6942d4b6e tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:55.311906 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-91571164-cde3-42e3-814f-29e6942d4b6e tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:55.312332 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-91571164-cde3-42e3-814f-29e6942d4b6e tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:55.496520 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-0716124c-1904-4ef2-a1a4-102c2880141c tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:55.507186 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-0716124c-1904-4ef2-a1a4-102c2880141c tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca" status: 200 len: 1520 microversion: 2.1 time: 0.553687 Oct 29 01:32:55.508284 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 346/699] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:54 2021] GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca => generated 1520 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:32:55.692604 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-91571164-cde3-42e3-814f-29e6942d4b6e tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ad077fd0164d3c8b4db14262186901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa66fedc6704473996d04ffbf8135e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:55.700408 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-91571164-cde3-42e3-814f-29e6942d4b6e tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] 10.222.0.87 "GET /compute/v2.1/servers/c49107f1-6a48-4184-8bb6-fa2f027193ba" status: 200 len: 1507 microversion: 2.1 time: 0.405317 Oct 29 01:32:55.711855 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 354/700] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:55 2021] GET /compute/v2.1/servers/c49107f1-6a48-4184-8bb6-fa2f027193ba => generated 1507 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:32:55.717476 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-d8190bf2-17de-403d-bb3e-718e78ca44c8 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "65dbe911-c6ce-4926-b458-2039ba28a52d", "device": "/dev/sdb"}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:32:55.719218 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-d8190bf2-17de-403d-bb3e-718e78ca44c8 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] [instance: c49107f1-6a48-4184-8bb6-fa2f027193ba] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:55.727183 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d8190bf2-17de-403d-bb3e-718e78ca44c8 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:55.728386 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d8190bf2-17de-403d-bb3e-718e78ca44c8 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:55.729452 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d8190bf2-17de-403d-bb3e-718e78ca44c8 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:55.729879 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d8190bf2-17de-403d-bb3e-718e78ca44c8 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:55.970987 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-f86784f4-39aa-4730-97bd-e940e0731407 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:55.979567 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-f86784f4-39aa-4730-97bd-e940e0731407 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:55.995053 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-f86784f4-39aa-4730-97bd-e940e0731407 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:55.995858 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-f86784f4-39aa-4730-97bd-e940e0731407 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:55.997228 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-f86784f4-39aa-4730-97bd-e940e0731407 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:55.997801 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-f86784f4-39aa-4730-97bd-e940e0731407 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:56.337559 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-f86784f4-39aa-4730-97bd-e940e0731407 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045dda1ff9b44334954c08e63fcd20c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51a2093a0874d52a08f6e25489ba181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:56.347901 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-f86784f4-39aa-4730-97bd-e940e0731407 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92" status: 200 len: 1664 microversion: 2.1 time: 0.384831 Oct 29 01:32:56.351130 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 355/701] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:55 2021] GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92 => generated 1664 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:32:56.359560 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-cb4fb0e7-2e5c-433c-a96d-5d302f404c4d tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:56.367234 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-cb4fb0e7-2e5c-433c-a96d-5d302f404c4d tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:56.375247 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-cb4fb0e7-2e5c-433c-a96d-5d302f404c4d tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:56.385066 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-cb4fb0e7-2e5c-433c-a96d-5d302f404c4d tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:56.389561 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-cb4fb0e7-2e5c-433c-a96d-5d302f404c4d tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:56.389561 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-cb4fb0e7-2e5c-433c-a96d-5d302f404c4d tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:56.732742 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-cb4fb0e7-2e5c-433c-a96d-5d302f404c4d tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:56.742792 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-cb4fb0e7-2e5c-433c-a96d-5d302f404c4d tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:56.745287 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-cb4fb0e7-2e5c-433c-a96d-5d302f404c4d tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:56.746759 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-cb4fb0e7-2e5c-433c-a96d-5d302f404c4d tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1795 microversion: 2.20 time: 0.390849 Oct 29 01:32:56.757872 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 356/702] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:32:56 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1795 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:32:56.776305 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-70283641-004f-47fb-a791-2f50a40a19d4 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:56.781504 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-70283641-004f-47fb-a791-2f50a40a19d4 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:56.793719 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-70283641-004f-47fb-a791-2f50a40a19d4 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:56.794827 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-70283641-004f-47fb-a791-2f50a40a19d4 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:56.796123 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-70283641-004f-47fb-a791-2f50a40a19d4 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:56.796776 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-70283641-004f-47fb-a791-2f50a40a19d4 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:56.798664 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-d8190bf2-17de-403d-bb3e-718e78ca44c8 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] 10.222.0.87 "POST /compute/v2.1/servers/c49107f1-6a48-4184-8bb6-fa2f027193ba/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.084882 Oct 29 01:32:56.801886 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 347/703] 10.222.0.87 () {60 vars in 1322 bytes} [Fri Oct 29 01:32:55 2021] POST /compute/v2.1/servers/c49107f1-6a48-4184-8bb6-fa2f027193ba/os-volume_attachments => generated 194 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:32:57.080255 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-70283641-004f-47fb-a791-2f50a40a19d4 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:57.115477 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-70283641-004f-47fb-a791-2f50a40a19d4 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca" status: 200 len: 1520 microversion: 2.1 time: 0.355556 Oct 29 01:32:57.116985 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 357/704] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:56 2021] GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca => generated 1520 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:32:57.370829 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-93770b23-3953-4432-b96d-c6e154a95f51 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:57.371893 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-93770b23-3953-4432-b96d-c6e154a95f51 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:57.387166 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-93770b23-3953-4432-b96d-c6e154a95f51 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:57.387610 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-93770b23-3953-4432-b96d-c6e154a95f51 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:57.407151 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-93770b23-3953-4432-b96d-c6e154a95f51 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:57.413062 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-93770b23-3953-4432-b96d-c6e154a95f51 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:57.537931 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [req-7607e1a2-c874-4dba-850f-2b055182a51c req-6abddca9-4a40-4806-aa18-e80796ee8375 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09875e40-e63d-4175-9361-fd9439c0c7ca", "name": "network-vif-deleted", "tag": "ccaf14e9-30a4-4d96-9861-9c9c8b5e2172"}]} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:32:57.542502 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:32:57.542502 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: warnings.warn(msg) Oct 29 01:32:57.561709 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [req-7607e1a2-c874-4dba-850f-2b055182a51c req-6abddca9-4a40-4806-aa18-e80796ee8375 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:57.562288 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [req-7607e1a2-c874-4dba-850f-2b055182a51c req-6abddca9-4a40-4806-aa18-e80796ee8375 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:57.584016 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.compute.server_external_events [req-7607e1a2-c874-4dba-850f-2b055182a51c req-6abddca9-4a40-4806-aa18-e80796ee8375 service nova] Creating event network-vif-deleted:ccaf14e9-30a4-4d96-9861-9c9c8b5e2172 for instance 09875e40-e63d-4175-9361-fd9439c0c7ca on hv-cinder-81398 Oct 29 01:32:57.590575 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [req-7607e1a2-c874-4dba-850f-2b055182a51c req-6abddca9-4a40-4806-aa18-e80796ee8375 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068271 Oct 29 01:32:57.592170 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 358/705] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Oct 29 01:32:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:32:57.664733 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-93770b23-3953-4432-b96d-c6e154a95f51 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045dda1ff9b44334954c08e63fcd20c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51a2093a0874d52a08f6e25489ba181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:57.672848 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-93770b23-3953-4432-b96d-c6e154a95f51 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92" status: 200 len: 1668 microversion: 2.1 time: 0.308472 Oct 29 01:32:57.673411 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 348/706] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:57 2021] GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92 => generated 1668 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:32:57.854977 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-4e137f88-dc90-4373-a78b-ac2e29bd61c5 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Action: 'create', calling method: .version_select at 0x7ff62c130a60>, body: {"keypair": {"name": "tempest-TestShelveInstance-1259817571"}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:32:57.872184 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.quota [None req-4e137f88-dc90-4373-a78b-ac2e29bd61c5 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Getting quotas for project fea0db42704249b29fba70abbda7991c. Resources: {'key_pairs'} {{(pid=116378) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 01:32:57.876331 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.quota [None req-4e137f88-dc90-4373-a78b-ac2e29bd61c5 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Getting quotas for user 7c50a525003e427ba5ff9dea8f4ed47e and project fea0db42704249b29fba70abbda7991c. Resources: {'key_pairs'} {{(pid=116378) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 01:32:58.134846 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-b45d0154-f7fc-4e2e-b63c-4b2f7ba8b572 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:58.135658 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-b45d0154-f7fc-4e2e-b63c-4b2f7ba8b572 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:58.141800 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-b45d0154-f7fc-4e2e-b63c-4b2f7ba8b572 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:58.142250 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-b45d0154-f7fc-4e2e-b63c-4b2f7ba8b572 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:58.143021 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-b45d0154-f7fc-4e2e-b63c-4b2f7ba8b572 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:58.143451 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-b45d0154-f7fc-4e2e-b63c-4b2f7ba8b572 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:58.179237 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-b45d0154-f7fc-4e2e-b63c-4b2f7ba8b572 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:58.179694 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-b45d0154-f7fc-4e2e-b63c-4b2f7ba8b572 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:58.180087 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.objects.instance [None req-b45d0154-f7fc-4e2e-b63c-4b2f7ba8b572 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lazy-loading 'fault' on Instance uuid 09875e40-e63d-4175-9361-fd9439c0c7ca {{(pid=116379) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 01:32:58.209787 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.quota [None req-4e137f88-dc90-4373-a78b-ac2e29bd61c5 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Getting quotas for project fea0db42704249b29fba70abbda7991c. Resources: {'key_pairs'} {{(pid=116378) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 01:32:58.216678 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.quota [None req-4e137f88-dc90-4373-a78b-ac2e29bd61c5 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Getting quotas for user 7c50a525003e427ba5ff9dea8f4ed47e and project fea0db42704249b29fba70abbda7991c. Resources: {'key_pairs'} {{(pid=116378) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 01:32:58.227871 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-b45d0154-f7fc-4e2e-b63c-4b2f7ba8b572 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac27192a9b2148f4bff8814f63813098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b037cd872fe4e0b8b9429048c567b1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:32:58.233388 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-4e137f88-dc90-4373-a78b-ac2e29bd61c5 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.546149 Oct 29 01:32:58.234101 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 359/707] 10.222.0.87 () {60 vars in 1157 bytes} [Fri Oct 29 01:32:57 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:32:58.236321 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-b45d0154-f7fc-4e2e-b63c-4b2f7ba8b572 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca" status: 200 len: 1311 microversion: 2.1 time: 0.105729 Oct 29 01:32:58.242178 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 349/708] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:58 2021] GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca => generated 1311 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:32:59.254882 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-ebacdaca-0d87-46e0-a7d3-494e441ca8d4 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:32:59.255969 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-ebacdaca-0d87-46e0-a7d3-494e441ca8d4 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] [instance: 09875e40-e63d-4175-9361-fd9439c0c7ca] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:32:59.270758 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ebacdaca-0d87-46e0-a7d3-494e441ca8d4 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:59.270758 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ebacdaca-0d87-46e0-a7d3-494e441ca8d4 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:59.270758 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ebacdaca-0d87-46e0-a7d3-494e441ca8d4 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:32:59.270758 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ebacdaca-0d87-46e0-a7d3-494e441ca8d4 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:32:59.282849 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.wsgi [None req-ebacdaca-0d87-46e0-a7d3-494e441ca8d4 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] HTTP exception thrown: Instance 09875e40-e63d-4175-9361-fd9439c0c7ca could not be found. Oct 29 01:32:59.283557 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-ebacdaca-0d87-46e0-a7d3-494e441ca8d4 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] Returning 404 to user: Instance 09875e40-e63d-4175-9361-fd9439c0c7ca could not be found. {{(pid=116378) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:32:59.285133 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-ebacdaca-0d87-46e0-a7d3-494e441ca8d4 tempest-ServerRescueNegativeTestJSON-239435396 tempest-ServerRescueNegativeTestJSON-239435396-project] 10.222.0.87 "GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca" status: 404 len: 111 microversion: 2.1 time: 0.033759 Oct 29 01:32:59.286237 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 360/709] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:32:59 2021] GET /compute/v2.1/servers/09875e40-e63d-4175-9361-fd9439c0c7ca => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:33:18.357611 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-d33f3bf4-7636-4dd3-8129-c0ccced88eb1 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Action: 'create', calling method: .version_select at 0x7ff62c047820>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1481000100"}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:33:18.380356 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.quota [None req-d33f3bf4-7636-4dd3-8129-c0ccced88eb1 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Getting quotas for project 84bceeeb4f67456a90779360ffc620aa. Resources: {'key_pairs'} {{(pid=116379) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 01:33:18.385065 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.quota [None req-d33f3bf4-7636-4dd3-8129-c0ccced88eb1 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Getting quotas for user bef8571ef39b4efe8f510a28052e2b6f and project 84bceeeb4f67456a90779360ffc620aa. Resources: {'key_pairs'} {{(pid=116379) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 01:33:18.712373 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.quota [None req-d33f3bf4-7636-4dd3-8129-c0ccced88eb1 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Getting quotas for project 84bceeeb4f67456a90779360ffc620aa. Resources: {'key_pairs'} {{(pid=116379) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 01:33:18.716055 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.quota [None req-d33f3bf4-7636-4dd3-8129-c0ccced88eb1 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Getting quotas for user bef8571ef39b4efe8f510a28052e2b6f and project 84bceeeb4f67456a90779360ffc620aa. Resources: {'key_pairs'} {{(pid=116379) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 01:33:18.729744 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-d33f3bf4-7636-4dd3-8129-c0ccced88eb1 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.586053 Oct 29 01:33:18.735220 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 350/710] 10.222.0.87 () {60 vars in 1157 bytes} [Fri Oct 29 01:33:18 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:33:19.507781 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-fe387d3b-cc6f-4410-8d2c-49ad25f6a8f7 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:19.508444 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-fe387d3b-cc6f-4410-8d2c-49ad25f6a8f7 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] [instance: c49107f1-6a48-4184-8bb6-fa2f027193ba] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:33:19.516147 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-fe387d3b-cc6f-4410-8d2c-49ad25f6a8f7 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:19.516696 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-fe387d3b-cc6f-4410-8d2c-49ad25f6a8f7 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:19.517733 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-fe387d3b-cc6f-4410-8d2c-49ad25f6a8f7 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:19.519121 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-fe387d3b-cc6f-4410-8d2c-49ad25f6a8f7 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:19.600367 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.objects.instance [None req-fe387d3b-cc6f-4410-8d2c-49ad25f6a8f7 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lazy-loading 'services' on Instance uuid c49107f1-6a48-4184-8bb6-fa2f027193ba {{(pid=116378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 01:33:19.972737 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-fe387d3b-cc6f-4410-8d2c-49ad25f6a8f7 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] 10.222.0.87 "DELETE /compute/v2.1/servers/c49107f1-6a48-4184-8bb6-fa2f027193ba/os-volume_attachments/65dbe911-c6ce-4926-b458-2039ba28a52d" status: 202 len: 0 microversion: 2.1 time: 0.468990 Oct 29 01:33:19.973337 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 361/711] 10.222.0.87 () {58 vars in 1415 bytes} [Fri Oct 29 01:33:19 2021] DELETE /compute/v2.1/servers/c49107f1-6a48-4184-8bb6-fa2f027193ba/os-volume_attachments/65dbe911-c6ce-4926-b458-2039ba28a52d => generated 0 bytes in 470 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:33:21.167511 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-5b9696f4-fb24-4792-af2e-6c0dcb58dc7a tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:21.168147 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-5b9696f4-fb24-4792-af2e-6c0dcb58dc7a tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] [instance: c49107f1-6a48-4184-8bb6-fa2f027193ba] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:33:21.174174 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-5b9696f4-fb24-4792-af2e-6c0dcb58dc7a tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:21.175324 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-5b9696f4-fb24-4792-af2e-6c0dcb58dc7a tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:21.183224 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-5b9696f4-fb24-4792-af2e-6c0dcb58dc7a tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:21.183224 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-5b9696f4-fb24-4792-af2e-6c0dcb58dc7a tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:21.203642 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-5b9696f4-fb24-4792-af2e-6c0dcb58dc7a tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] [instance: c49107f1-6a48-4184-8bb6-fa2f027193ba] Going to try to terminate instance {{(pid=116379) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 29 01:33:21.683338 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-5b9696f4-fb24-4792-af2e-6c0dcb58dc7a tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] 10.222.0.87 "DELETE /compute/v2.1/servers/c49107f1-6a48-4184-8bb6-fa2f027193ba" status: 204 len: 0 microversion: 2.1 time: 0.519765 Oct 29 01:33:21.688091 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 351/712] 10.222.0.87 () {58 vars in 1238 bytes} [Fri Oct 29 01:33:21 2021] DELETE /compute/v2.1/servers/c49107f1-6a48-4184-8bb6-fa2f027193ba => generated 0 bytes in 525 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:33:21.699057 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-ffcf51cb-0db4-477d-bb56-96e2fd5dd8c8 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:21.708272 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-ffcf51cb-0db4-477d-bb56-96e2fd5dd8c8 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] [instance: c49107f1-6a48-4184-8bb6-fa2f027193ba] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:33:21.732765 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ffcf51cb-0db4-477d-bb56-96e2fd5dd8c8 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:21.733419 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ffcf51cb-0db4-477d-bb56-96e2fd5dd8c8 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:21.734541 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ffcf51cb-0db4-477d-bb56-96e2fd5dd8c8 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:21.735129 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ffcf51cb-0db4-477d-bb56-96e2fd5dd8c8 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:21.915049 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-ffcf51cb-0db4-477d-bb56-96e2fd5dd8c8 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ad077fd0164d3c8b4db14262186901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa66fedc6704473996d04ffbf8135e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:21.923689 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-ffcf51cb-0db4-477d-bb56-96e2fd5dd8c8 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] 10.222.0.87 "GET /compute/v2.1/servers/c49107f1-6a48-4184-8bb6-fa2f027193ba" status: 200 len: 1513 microversion: 2.1 time: 0.230066 Oct 29 01:33:21.929018 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 362/713] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:33:21 2021] GET /compute/v2.1/servers/c49107f1-6a48-4184-8bb6-fa2f027193ba => generated 1513 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:33:22.945958 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-df3d31e7-b6b6-4083-861b-817cc9a6f5e3 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:22.947289 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-df3d31e7-b6b6-4083-861b-817cc9a6f5e3 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] [instance: c49107f1-6a48-4184-8bb6-fa2f027193ba] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:33:22.953413 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-df3d31e7-b6b6-4083-861b-817cc9a6f5e3 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:22.953862 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-df3d31e7-b6b6-4083-861b-817cc9a6f5e3 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:22.954648 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-df3d31e7-b6b6-4083-861b-817cc9a6f5e3 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:22.955076 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-df3d31e7-b6b6-4083-861b-817cc9a6f5e3 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:23.088904 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-df3d31e7-b6b6-4083-861b-817cc9a6f5e3 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ad077fd0164d3c8b4db14262186901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa66fedc6704473996d04ffbf8135e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:23.096873 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-df3d31e7-b6b6-4083-861b-817cc9a6f5e3 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] 10.222.0.87 "GET /compute/v2.1/servers/c49107f1-6a48-4184-8bb6-fa2f027193ba" status: 200 len: 1513 microversion: 2.1 time: 0.155124 Oct 29 01:33:23.098075 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 352/714] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:33:22 2021] GET /compute/v2.1/servers/c49107f1-6a48-4184-8bb6-fa2f027193ba => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:33:23.646373 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-40908d2a-93bd-4c02-83ce-ea87baaf71fc tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1484749518", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1259817571", "security_groups": [{"name": "tempest-secgroup-smoke-1208106016"}], "networks": [{"uuid": "acba2ac2-4dda-4f15-b3fb-5874b71db82d"}], "block_device_mapping_v2": [{"uuid": "526226a2-34f1-4a27-86ab-c39f403df990", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:33:23.750173 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.network.neutron [None req-40908d2a-93bd-4c02-83ce-ea87baaf71fc tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] validate_networks() for [('acba2ac2-4dda-4f15-b3fb-5874b71db82d', None, None, None, None, None)] {{(pid=116378) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 29 01:33:24.114369 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-74620c27-1bec-4311-a35b-9ec0a107c106 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:24.115177 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-74620c27-1bec-4311-a35b-9ec0a107c106 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] [instance: c49107f1-6a48-4184-8bb6-fa2f027193ba] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:33:24.122123 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-74620c27-1bec-4311-a35b-9ec0a107c106 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:24.122561 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-74620c27-1bec-4311-a35b-9ec0a107c106 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:24.123327 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-74620c27-1bec-4311-a35b-9ec0a107c106 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:24.123769 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-74620c27-1bec-4311-a35b-9ec0a107c106 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:24.215384 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.virt.hardware [None req-40908d2a-93bd-4c02-83ce-ea87baaf71fc tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Flavor limits 0:0:0 {{(pid=116378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:33:24.215869 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.virt.hardware [None req-40908d2a-93bd-4c02-83ce-ea87baaf71fc tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Image limits 0:0:0 {{(pid=116378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:33:24.216373 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.virt.hardware [None req-40908d2a-93bd-4c02-83ce-ea87baaf71fc tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Flavor pref 0:0:0 {{(pid=116378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:33:24.216778 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.virt.hardware [None req-40908d2a-93bd-4c02-83ce-ea87baaf71fc tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Image pref 0:0:0 {{(pid=116378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:33:24.217189 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.virt.hardware [None req-40908d2a-93bd-4c02-83ce-ea87baaf71fc tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:33:24.226220 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-40908d2a-93bd-4c02-83ce-ea87baaf71fc tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:24.226667 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-40908d2a-93bd-4c02-83ce-ea87baaf71fc tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:24.227519 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-40908d2a-93bd-4c02-83ce-ea87baaf71fc tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:24.228557 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-40908d2a-93bd-4c02-83ce-ea87baaf71fc tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:24.247824 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.quota [None req-40908d2a-93bd-4c02-83ce-ea87baaf71fc tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Getting quotas for project fea0db42704249b29fba70abbda7991c. Resources: {'instances', 'cores', 'ram'} {{(pid=116378) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 01:33:24.252662 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.quota [None req-40908d2a-93bd-4c02-83ce-ea87baaf71fc tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Getting quotas for user 7c50a525003e427ba5ff9dea8f4ed47e and project fea0db42704249b29fba70abbda7991c. Resources: {'instances', 'cores', 'ram'} {{(pid=116378) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 01:33:24.290557 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-74620c27-1bec-4311-a35b-9ec0a107c106 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ad077fd0164d3c8b4db14262186901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa66fedc6704473996d04ffbf8135e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:24.298708 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-74620c27-1bec-4311-a35b-9ec0a107c106 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] 10.222.0.87 "GET /compute/v2.1/servers/c49107f1-6a48-4184-8bb6-fa2f027193ba" status: 200 len: 1513 microversion: 2.1 time: 0.188049 Oct 29 01:33:24.299655 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 353/715] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:33:24 2021] GET /compute/v2.1/servers/c49107f1-6a48-4184-8bb6-fa2f027193ba => generated 1513 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:33:24.325934 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-40908d2a-93bd-4c02-83ce-ea87baaf71fc tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Going to run 1 instances... {{(pid=116378) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 29 01:33:24.328345 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-40908d2a-93bd-4c02-83ce-ea87baaf71fc tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] [instance: 58f3409d-cd2a-4bef-9ae4-2fba782b321f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='526226a2-34f1-4a27-86ab-c39f403df990',volume_size=None,volume_type=None)] {{(pid=116378) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 29 01:33:24.770019 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-40908d2a-93bd-4c02-83ce-ea87baaf71fc tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.127955 Oct 29 01:33:24.770983 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 363/716] 10.222.0.87 () {60 vars in 1146 bytes} [Fri Oct 29 01:33:23 2021] POST /compute/v2.1/servers => generated 406 bytes in 1129 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:33:24.780743 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-56a7cb8c-9741-436a-858c-ea8918d8ebc3 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:24.781384 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-56a7cb8c-9741-436a-858c-ea8918d8ebc3 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] [instance: 58f3409d-cd2a-4bef-9ae4-2fba782b321f] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:33:24.867993 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-56a7cb8c-9741-436a-858c-ea8918d8ebc3 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c50a525003e427ba5ff9dea8f4ed47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0db42704249b29fba70abbda7991c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:24.876624 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-56a7cb8c-9741-436a-858c-ea8918d8ebc3 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] 10.222.0.87 "GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f" status: 200 len: 1089 microversion: 2.1 time: 0.099306 Oct 29 01:33:24.877222 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 354/717] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:33:24 2021] GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f => generated 1089 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:33:25.318355 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-396ecd1b-a6e8-4254-a298-34ac0cf807cc tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:25.319496 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-396ecd1b-a6e8-4254-a298-34ac0cf807cc tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] [instance: c49107f1-6a48-4184-8bb6-fa2f027193ba] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:33:25.327694 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-396ecd1b-a6e8-4254-a298-34ac0cf807cc tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:25.328229 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-396ecd1b-a6e8-4254-a298-34ac0cf807cc tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:25.329018 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-396ecd1b-a6e8-4254-a298-34ac0cf807cc tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:25.329450 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-396ecd1b-a6e8-4254-a298-34ac0cf807cc tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:25.364374 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [req-9c495493-a3f5-4a1d-96a7-1be09537baaa req-893814a2-c454-4760-bf9c-d71b409471a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c49107f1-6a48-4184-8bb6-fa2f027193ba", "name": "network-vif-deleted", "tag": "c07b84b3-5be0-4f7b-8bb4-7af5141edcb7"}]} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:33:25.366574 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:33:25.366574 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: warnings.warn(msg) Oct 29 01:33:25.374820 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [req-9c495493-a3f5-4a1d-96a7-1be09537baaa req-893814a2-c454-4760-bf9c-d71b409471a2 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:25.375259 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [req-9c495493-a3f5-4a1d-96a7-1be09537baaa req-893814a2-c454-4760-bf9c-d71b409471a2 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:25.387031 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.compute.server_external_events [req-9c495493-a3f5-4a1d-96a7-1be09537baaa req-893814a2-c454-4760-bf9c-d71b409471a2 service nova] Creating event network-vif-deleted:c07b84b3-5be0-4f7b-8bb4-7af5141edcb7 for instance c49107f1-6a48-4184-8bb6-fa2f027193ba on hv-cinder-81398 Oct 29 01:33:25.392256 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [req-9c495493-a3f5-4a1d-96a7-1be09537baaa req-893814a2-c454-4760-bf9c-d71b409471a2 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031236 Oct 29 01:33:25.393179 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 355/718] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Oct 29 01:33:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:33:25.397289 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-396ecd1b-a6e8-4254-a298-34ac0cf807cc tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ad077fd0164d3c8b4db14262186901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa66fedc6704473996d04ffbf8135e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:25.406435 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-396ecd1b-a6e8-4254-a298-34ac0cf807cc tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] 10.222.0.87 "GET /compute/v2.1/servers/c49107f1-6a48-4184-8bb6-fa2f027193ba" status: 200 len: 1471 microversion: 2.1 time: 0.092278 Oct 29 01:33:25.406998 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 364/719] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:33:25 2021] GET /compute/v2.1/servers/c49107f1-6a48-4184-8bb6-fa2f027193ba => generated 1471 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:33:25.894751 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-5448c945-2b67-4296-a53b-1c09d4fe27ec tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:25.895460 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-5448c945-2b67-4296-a53b-1c09d4fe27ec tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] [instance: 58f3409d-cd2a-4bef-9ae4-2fba782b321f] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:33:25.901992 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-5448c945-2b67-4296-a53b-1c09d4fe27ec tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:25.902431 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-5448c945-2b67-4296-a53b-1c09d4fe27ec tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:25.903198 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-5448c945-2b67-4296-a53b-1c09d4fe27ec tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:25.903624 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-5448c945-2b67-4296-a53b-1c09d4fe27ec tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:25.967235 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-5448c945-2b67-4296-a53b-1c09d4fe27ec tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c50a525003e427ba5ff9dea8f4ed47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0db42704249b29fba70abbda7991c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:25.974605 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-5448c945-2b67-4296-a53b-1c09d4fe27ec tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] 10.222.0.87 "GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f" status: 200 len: 1139 microversion: 2.1 time: 0.084132 Oct 29 01:33:25.975208 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 356/720] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:33:25 2021] GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f => generated 1139 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:33:26.427283 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-ae08a2e2-ba39-423c-84db-fbf9eef1386e tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:26.427963 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-ae08a2e2-ba39-423c-84db-fbf9eef1386e tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] [instance: c49107f1-6a48-4184-8bb6-fa2f027193ba] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:33:26.435406 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ae08a2e2-ba39-423c-84db-fbf9eef1386e tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:26.435917 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ae08a2e2-ba39-423c-84db-fbf9eef1386e tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:26.436696 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ae08a2e2-ba39-423c-84db-fbf9eef1386e tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:26.437127 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ae08a2e2-ba39-423c-84db-fbf9eef1386e tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:26.500495 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-ae08a2e2-ba39-423c-84db-fbf9eef1386e tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ad077fd0164d3c8b4db14262186901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa66fedc6704473996d04ffbf8135e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:26.507848 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-ae08a2e2-ba39-423c-84db-fbf9eef1386e tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] 10.222.0.87 "GET /compute/v2.1/servers/c49107f1-6a48-4184-8bb6-fa2f027193ba" status: 200 len: 1303 microversion: 2.1 time: 0.084198 Oct 29 01:33:26.508419 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 365/721] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:33:26 2021] GET /compute/v2.1/servers/c49107f1-6a48-4184-8bb6-fa2f027193ba => generated 1303 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:33:26.991857 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-4a4340de-a280-4bd2-b843-e95568ba2b8e tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:26.993144 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-4a4340de-a280-4bd2-b843-e95568ba2b8e tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] [instance: 58f3409d-cd2a-4bef-9ae4-2fba782b321f] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:33:26.999902 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-4a4340de-a280-4bd2-b843-e95568ba2b8e tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:27.000349 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-4a4340de-a280-4bd2-b843-e95568ba2b8e tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:27.001124 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-4a4340de-a280-4bd2-b843-e95568ba2b8e tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:27.001551 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-4a4340de-a280-4bd2-b843-e95568ba2b8e tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:27.062527 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-4a4340de-a280-4bd2-b843-e95568ba2b8e tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c50a525003e427ba5ff9dea8f4ed47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0db42704249b29fba70abbda7991c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:27.070134 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-4a4340de-a280-4bd2-b843-e95568ba2b8e tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] 10.222.0.87 "GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f" status: 200 len: 1139 microversion: 2.1 time: 0.082078 Oct 29 01:33:27.070698 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 357/722] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:33:26 2021] GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f => generated 1139 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:33:27.525130 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-0f421525-04ff-4e73-8569-9f3202998cc9 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:27.525827 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-0f421525-04ff-4e73-8569-9f3202998cc9 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] [instance: c49107f1-6a48-4184-8bb6-fa2f027193ba] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:33:27.531714 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-0f421525-04ff-4e73-8569-9f3202998cc9 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:27.532197 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-0f421525-04ff-4e73-8569-9f3202998cc9 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:27.532933 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-0f421525-04ff-4e73-8569-9f3202998cc9 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:27.533354 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-0f421525-04ff-4e73-8569-9f3202998cc9 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:27.565015 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-0f421525-04ff-4e73-8569-9f3202998cc9 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:27.565531 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-0f421525-04ff-4e73-8569-9f3202998cc9 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:27.566122 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.objects.instance [None req-0f421525-04ff-4e73-8569-9f3202998cc9 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lazy-loading 'fault' on Instance uuid c49107f1-6a48-4184-8bb6-fa2f027193ba {{(pid=116378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 01:33:27.609312 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-0f421525-04ff-4e73-8569-9f3202998cc9 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ad077fd0164d3c8b4db14262186901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa66fedc6704473996d04ffbf8135e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:27.616771 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-0f421525-04ff-4e73-8569-9f3202998cc9 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] 10.222.0.87 "GET /compute/v2.1/servers/c49107f1-6a48-4184-8bb6-fa2f027193ba" status: 200 len: 1308 microversion: 2.1 time: 0.095479 Oct 29 01:33:27.617384 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 366/723] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:33:27 2021] GET /compute/v2.1/servers/c49107f1-6a48-4184-8bb6-fa2f027193ba => generated 1308 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:33:28.088881 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-2bfe8919-1c70-475d-9e4f-426956585c89 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:28.089479 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-2bfe8919-1c70-475d-9e4f-426956585c89 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] [instance: 58f3409d-cd2a-4bef-9ae4-2fba782b321f] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:33:28.095664 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-2bfe8919-1c70-475d-9e4f-426956585c89 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:28.096145 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-2bfe8919-1c70-475d-9e4f-426956585c89 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:28.097195 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-2bfe8919-1c70-475d-9e4f-426956585c89 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:28.097563 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-2bfe8919-1c70-475d-9e4f-426956585c89 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:28.163317 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-2bfe8919-1c70-475d-9e4f-426956585c89 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c50a525003e427ba5ff9dea8f4ed47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0db42704249b29fba70abbda7991c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:28.172948 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-2bfe8919-1c70-475d-9e4f-426956585c89 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] 10.222.0.87 "GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f" status: 200 len: 1187 microversion: 2.1 time: 0.088980 Oct 29 01:33:28.173522 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 358/724] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:33:28 2021] GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f => generated 1187 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:33:28.635867 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-11e31e25-80df-441b-98f3-6a60b6982636 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:28.636537 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-11e31e25-80df-441b-98f3-6a60b6982636 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] [instance: c49107f1-6a48-4184-8bb6-fa2f027193ba] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:33:28.643029 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-11e31e25-80df-441b-98f3-6a60b6982636 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:28.643496 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-11e31e25-80df-441b-98f3-6a60b6982636 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:28.644352 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-11e31e25-80df-441b-98f3-6a60b6982636 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:28.644774 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-11e31e25-80df-441b-98f3-6a60b6982636 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:28.657848 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.wsgi [None req-11e31e25-80df-441b-98f3-6a60b6982636 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] HTTP exception thrown: Instance c49107f1-6a48-4184-8bb6-fa2f027193ba could not be found. Oct 29 01:33:28.658436 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-11e31e25-80df-441b-98f3-6a60b6982636 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] Returning 404 to user: Instance c49107f1-6a48-4184-8bb6-fa2f027193ba could not be found. {{(pid=116378) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:33:28.659391 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-11e31e25-80df-441b-98f3-6a60b6982636 tempest-VolumesSnapshotTestJSON-746677236 tempest-VolumesSnapshotTestJSON-746677236-project] 10.222.0.87 "GET /compute/v2.1/servers/c49107f1-6a48-4184-8bb6-fa2f027193ba" status: 404 len: 111 microversion: 2.1 time: 0.028463 Oct 29 01:33:28.659951 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 367/725] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:33:28 2021] GET /compute/v2.1/servers/c49107f1-6a48-4184-8bb6-fa2f027193ba => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:33:29.190324 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-5c7174d1-08a8-4c0f-afe6-03c052a26e76 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:29.190922 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-5c7174d1-08a8-4c0f-afe6-03c052a26e76 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] [instance: 58f3409d-cd2a-4bef-9ae4-2fba782b321f] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:33:29.198167 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-5c7174d1-08a8-4c0f-afe6-03c052a26e76 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:29.198607 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-5c7174d1-08a8-4c0f-afe6-03c052a26e76 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:29.199382 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-5c7174d1-08a8-4c0f-afe6-03c052a26e76 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:29.199850 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-5c7174d1-08a8-4c0f-afe6-03c052a26e76 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:29.381885 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-5c7174d1-08a8-4c0f-afe6-03c052a26e76 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c50a525003e427ba5ff9dea8f4ed47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0db42704249b29fba70abbda7991c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:29.390058 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-5c7174d1-08a8-4c0f-afe6-03c052a26e76 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] 10.222.0.87 "GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f" status: 200 len: 1273 microversion: 2.1 time: 0.203443 Oct 29 01:33:29.390634 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 359/726] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:33:29 2021] GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f => generated 1273 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:33:30.182649 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [req-1465301b-20d4-4a99-81ef-c90e8dc5455a req-3ede008a-eb8d-47f4-bdea-1e3d5d276976 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58f3409d-cd2a-4bef-9ae4-2fba782b321f", "tag": "b9061b77-a5c8-4ac6-9f65-0f8712ee20cf"}]} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:33:30.184372 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:33:30.184372 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: warnings.warn(msg) Oct 29 01:33:30.191992 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [req-1465301b-20d4-4a99-81ef-c90e8dc5455a req-3ede008a-eb8d-47f4-bdea-1e3d5d276976 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:30.192127 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [req-1465301b-20d4-4a99-81ef-c90e8dc5455a req-3ede008a-eb8d-47f4-bdea-1e3d5d276976 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:30.210716 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.compute.server_external_events [req-1465301b-20d4-4a99-81ef-c90e8dc5455a req-3ede008a-eb8d-47f4-bdea-1e3d5d276976 service nova] Creating event network-changed:b9061b77-a5c8-4ac6-9f65-0f8712ee20cf for instance 58f3409d-cd2a-4bef-9ae4-2fba782b321f on hv-cinder-81398 Oct 29 01:33:30.216479 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [req-1465301b-20d4-4a99-81ef-c90e8dc5455a req-3ede008a-eb8d-47f4-bdea-1e3d5d276976 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039808 Oct 29 01:33:30.217338 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 368/727] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Oct 29 01:33:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:33:30.409726 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-6936985e-68a9-4da7-8b2f-7d43f8b4a7e6 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:30.409726 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-6936985e-68a9-4da7-8b2f-7d43f8b4a7e6 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] [instance: 58f3409d-cd2a-4bef-9ae4-2fba782b321f] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:33:30.414079 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-6936985e-68a9-4da7-8b2f-7d43f8b4a7e6 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:30.414472 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-6936985e-68a9-4da7-8b2f-7d43f8b4a7e6 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:30.415950 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-6936985e-68a9-4da7-8b2f-7d43f8b4a7e6 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:30.416396 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-6936985e-68a9-4da7-8b2f-7d43f8b4a7e6 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:30.599808 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-6936985e-68a9-4da7-8b2f-7d43f8b4a7e6 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c50a525003e427ba5ff9dea8f4ed47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0db42704249b29fba70abbda7991c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:30.618664 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-6936985e-68a9-4da7-8b2f-7d43f8b4a7e6 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] 10.222.0.87 "GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f" status: 200 len: 1261 microversion: 2.1 time: 0.214077 Oct 29 01:33:30.620095 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 360/728] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:33:30 2021] GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f => generated 1261 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:33:31.637206 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-53f037e3-9fb4-496e-a581-4f67f393fddf tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:31.637900 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-53f037e3-9fb4-496e-a581-4f67f393fddf tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] [instance: 58f3409d-cd2a-4bef-9ae4-2fba782b321f] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:33:31.643953 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-53f037e3-9fb4-496e-a581-4f67f393fddf tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:31.644496 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-53f037e3-9fb4-496e-a581-4f67f393fddf tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:31.645163 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-53f037e3-9fb4-496e-a581-4f67f393fddf tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:31.645592 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-53f037e3-9fb4-496e-a581-4f67f393fddf tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:31.768927 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-53f037e3-9fb4-496e-a581-4f67f393fddf tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c50a525003e427ba5ff9dea8f4ed47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0db42704249b29fba70abbda7991c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:31.776548 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-53f037e3-9fb4-496e-a581-4f67f393fddf tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] 10.222.0.87 "GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f" status: 200 len: 1261 microversion: 2.1 time: 0.144528 Oct 29 01:33:31.777286 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 369/729] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:33:31 2021] GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f => generated 1261 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:33:32.794901 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-4801823c-46bc-4934-a4a9-6bcbdb5188a5 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:32.795671 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-4801823c-46bc-4934-a4a9-6bcbdb5188a5 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] [instance: 58f3409d-cd2a-4bef-9ae4-2fba782b321f] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:33:32.802499 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-4801823c-46bc-4934-a4a9-6bcbdb5188a5 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:32.803234 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-4801823c-46bc-4934-a4a9-6bcbdb5188a5 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:32.804259 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-4801823c-46bc-4934-a4a9-6bcbdb5188a5 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:32.804691 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-4801823c-46bc-4934-a4a9-6bcbdb5188a5 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:32.981236 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-4801823c-46bc-4934-a4a9-6bcbdb5188a5 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c50a525003e427ba5ff9dea8f4ed47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0db42704249b29fba70abbda7991c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:32.988499 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-4801823c-46bc-4934-a4a9-6bcbdb5188a5 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] 10.222.0.87 "GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f" status: 200 len: 1261 microversion: 2.1 time: 0.199152 Oct 29 01:33:32.989061 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 361/730] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:33:32 2021] GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f => generated 1261 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:33:34.005072 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-76d9667d-96b0-4e68-977e-9dcafa5c0c05 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:34.005743 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-76d9667d-96b0-4e68-977e-9dcafa5c0c05 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] [instance: 58f3409d-cd2a-4bef-9ae4-2fba782b321f] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:33:34.015423 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-76d9667d-96b0-4e68-977e-9dcafa5c0c05 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:34.016172 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-76d9667d-96b0-4e68-977e-9dcafa5c0c05 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:34.016816 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-76d9667d-96b0-4e68-977e-9dcafa5c0c05 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:34.017240 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-76d9667d-96b0-4e68-977e-9dcafa5c0c05 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:34.146828 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-76d9667d-96b0-4e68-977e-9dcafa5c0c05 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c50a525003e427ba5ff9dea8f4ed47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0db42704249b29fba70abbda7991c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:34.167389 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-76d9667d-96b0-4e68-977e-9dcafa5c0c05 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] 10.222.0.87 "GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f" status: 200 len: 1261 microversion: 2.1 time: 0.165513 Oct 29 01:33:34.171609 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 370/731] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:33:34 2021] GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f => generated 1261 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:33:35.184569 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-47064a5e-c7f7-4dfd-8ea8-8ae87c19218a tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:35.185147 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-47064a5e-c7f7-4dfd-8ea8-8ae87c19218a tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] [instance: 58f3409d-cd2a-4bef-9ae4-2fba782b321f] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:33:35.191449 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-47064a5e-c7f7-4dfd-8ea8-8ae87c19218a tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:35.191869 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-47064a5e-c7f7-4dfd-8ea8-8ae87c19218a tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:35.192633 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-47064a5e-c7f7-4dfd-8ea8-8ae87c19218a tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:35.193062 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-47064a5e-c7f7-4dfd-8ea8-8ae87c19218a tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:35.324774 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-47064a5e-c7f7-4dfd-8ea8-8ae87c19218a tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c50a525003e427ba5ff9dea8f4ed47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0db42704249b29fba70abbda7991c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:35.333121 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-47064a5e-c7f7-4dfd-8ea8-8ae87c19218a tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] 10.222.0.87 "GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f" status: 200 len: 1261 microversion: 2.1 time: 0.152304 Oct 29 01:33:35.333685 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 362/732] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:33:35 2021] GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f => generated 1261 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:33:36.348919 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-4f22ca51-22f5-40e8-aaa0-5ba928e8d7db tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:36.349570 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-4f22ca51-22f5-40e8-aaa0-5ba928e8d7db tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] [instance: 58f3409d-cd2a-4bef-9ae4-2fba782b321f] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:33:36.356495 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4f22ca51-22f5-40e8-aaa0-5ba928e8d7db tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:36.356937 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4f22ca51-22f5-40e8-aaa0-5ba928e8d7db tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:36.357693 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4f22ca51-22f5-40e8-aaa0-5ba928e8d7db tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:36.358126 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4f22ca51-22f5-40e8-aaa0-5ba928e8d7db tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:36.482657 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-4f22ca51-22f5-40e8-aaa0-5ba928e8d7db tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c50a525003e427ba5ff9dea8f4ed47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0db42704249b29fba70abbda7991c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:36.490198 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-4f22ca51-22f5-40e8-aaa0-5ba928e8d7db tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] 10.222.0.87 "GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f" status: 200 len: 1261 microversion: 2.1 time: 0.144899 Oct 29 01:33:36.490799 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 371/733] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:33:36 2021] GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f => generated 1261 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:33:37.507317 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-b7873726-affe-4184-82d6-6c5d8d6f7520 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:37.507901 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-b7873726-affe-4184-82d6-6c5d8d6f7520 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] [instance: 58f3409d-cd2a-4bef-9ae4-2fba782b321f] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:33:37.514170 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-b7873726-affe-4184-82d6-6c5d8d6f7520 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:37.514615 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-b7873726-affe-4184-82d6-6c5d8d6f7520 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:37.515384 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-b7873726-affe-4184-82d6-6c5d8d6f7520 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:37.515842 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-b7873726-affe-4184-82d6-6c5d8d6f7520 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:37.638566 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-b7873726-affe-4184-82d6-6c5d8d6f7520 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c50a525003e427ba5ff9dea8f4ed47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0db42704249b29fba70abbda7991c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:37.645904 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-b7873726-affe-4184-82d6-6c5d8d6f7520 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] 10.222.0.87 "GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f" status: 200 len: 1261 microversion: 2.1 time: 0.142395 Oct 29 01:33:37.646457 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 363/734] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:33:37 2021] GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f => generated 1261 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:33:38.664670 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-bcb1f631-3d71-46ff-b168-d931df1c97c7 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:38.665508 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-bcb1f631-3d71-46ff-b168-d931df1c97c7 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] [instance: 58f3409d-cd2a-4bef-9ae4-2fba782b321f] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:33:38.672417 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-bcb1f631-3d71-46ff-b168-d931df1c97c7 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:38.672917 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-bcb1f631-3d71-46ff-b168-d931df1c97c7 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:38.673871 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-bcb1f631-3d71-46ff-b168-d931df1c97c7 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:38.674306 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-bcb1f631-3d71-46ff-b168-d931df1c97c7 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:38.936229 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-bcb1f631-3d71-46ff-b168-d931df1c97c7 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c50a525003e427ba5ff9dea8f4ed47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0db42704249b29fba70abbda7991c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:38.936229 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-bcb1f631-3d71-46ff-b168-d931df1c97c7 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] 10.222.0.87 "GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f" status: 200 len: 1261 microversion: 2.1 time: 0.149325 Oct 29 01:33:38.936229 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 372/735] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:33:38 2021] GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f => generated 1261 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:33:39.952669 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-79b9c913-63e4-4f97-bc80-9189f76949cb tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:39.953621 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-79b9c913-63e4-4f97-bc80-9189f76949cb tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] [instance: 58f3409d-cd2a-4bef-9ae4-2fba782b321f] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:33:39.960368 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-79b9c913-63e4-4f97-bc80-9189f76949cb tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:39.960819 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-79b9c913-63e4-4f97-bc80-9189f76949cb tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:39.961632 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-79b9c913-63e4-4f97-bc80-9189f76949cb tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:39.962063 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-79b9c913-63e4-4f97-bc80-9189f76949cb tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:40.085403 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-79b9c913-63e4-4f97-bc80-9189f76949cb tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c50a525003e427ba5ff9dea8f4ed47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0db42704249b29fba70abbda7991c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:40.093331 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-79b9c913-63e4-4f97-bc80-9189f76949cb tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] 10.222.0.87 "GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f" status: 200 len: 1261 microversion: 2.1 time: 0.146502 Oct 29 01:33:40.093889 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 364/736] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:33:39 2021] GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f => generated 1261 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:33:41.111219 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-6281a5b1-feee-494c-8782-7f0bab266e05 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:41.111852 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-6281a5b1-feee-494c-8782-7f0bab266e05 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] [instance: 58f3409d-cd2a-4bef-9ae4-2fba782b321f] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:33:41.118656 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-6281a5b1-feee-494c-8782-7f0bab266e05 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:41.119101 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-6281a5b1-feee-494c-8782-7f0bab266e05 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:41.120054 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-6281a5b1-feee-494c-8782-7f0bab266e05 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:41.120551 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-6281a5b1-feee-494c-8782-7f0bab266e05 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:41.196593 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [req-235c96c7-006c-4446-ae7f-b61d855b6477 req-67463ea8-5759-4ad4-8cb3-23b2aab3544c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58f3409d-cd2a-4bef-9ae4-2fba782b321f", "name": "network-vif-plugged", "status": "completed", "tag": "b9061b77-a5c8-4ac6-9f65-0f8712ee20cf"}]} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:33:41.200570 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:33:41.200570 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: warnings.warn(msg) Oct 29 01:33:41.206480 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [req-235c96c7-006c-4446-ae7f-b61d855b6477 req-67463ea8-5759-4ad4-8cb3-23b2aab3544c service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:41.206905 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [req-235c96c7-006c-4446-ae7f-b61d855b6477 req-67463ea8-5759-4ad4-8cb3-23b2aab3544c service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:41.218629 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.compute.server_external_events [req-235c96c7-006c-4446-ae7f-b61d855b6477 req-67463ea8-5759-4ad4-8cb3-23b2aab3544c service nova] Creating event network-vif-plugged:b9061b77-a5c8-4ac6-9f65-0f8712ee20cf for instance 58f3409d-cd2a-4bef-9ae4-2fba782b321f on hv-cinder-81398 Oct 29 01:33:41.223631 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [req-235c96c7-006c-4446-ae7f-b61d855b6477 req-67463ea8-5759-4ad4-8cb3-23b2aab3544c service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030909 Oct 29 01:33:41.224271 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 365/737] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Oct 29 01:33:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:33:41.251683 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-6281a5b1-feee-494c-8782-7f0bab266e05 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c50a525003e427ba5ff9dea8f4ed47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0db42704249b29fba70abbda7991c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:41.259907 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-6281a5b1-feee-494c-8782-7f0bab266e05 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] 10.222.0.87 "GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f" status: 200 len: 1261 microversion: 2.1 time: 0.153631 Oct 29 01:33:41.260488 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 373/738] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:33:41 2021] GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:33:42.278929 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-4e72112a-bb67-40c6-9670-56cdc2b29258 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:42.279636 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-4e72112a-bb67-40c6-9670-56cdc2b29258 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] [instance: 58f3409d-cd2a-4bef-9ae4-2fba782b321f] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:33:42.285778 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-4e72112a-bb67-40c6-9670-56cdc2b29258 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:42.286221 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-4e72112a-bb67-40c6-9670-56cdc2b29258 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:42.286977 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-4e72112a-bb67-40c6-9670-56cdc2b29258 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:42.287406 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-4e72112a-bb67-40c6-9670-56cdc2b29258 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:42.662847 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-4e72112a-bb67-40c6-9670-56cdc2b29258 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c50a525003e427ba5ff9dea8f4ed47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0db42704249b29fba70abbda7991c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:42.670320 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-4e72112a-bb67-40c6-9670-56cdc2b29258 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] 10.222.0.87 "GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f" status: 200 len: 1261 microversion: 2.1 time: 0.395858 Oct 29 01:33:42.671473 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 366/739] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:33:42 2021] GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f => generated 1261 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:33:43.689236 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-7413fb5b-0768-4971-b27a-e951812db639 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:43.689236 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-7413fb5b-0768-4971-b27a-e951812db639 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] [instance: 58f3409d-cd2a-4bef-9ae4-2fba782b321f] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:33:43.694939 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-7413fb5b-0768-4971-b27a-e951812db639 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:43.695382 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-7413fb5b-0768-4971-b27a-e951812db639 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:43.696169 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-7413fb5b-0768-4971-b27a-e951812db639 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:43.696652 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-7413fb5b-0768-4971-b27a-e951812db639 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:43.820276 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-7413fb5b-0768-4971-b27a-e951812db639 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c50a525003e427ba5ff9dea8f4ed47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0db42704249b29fba70abbda7991c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:43.828302 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-7413fb5b-0768-4971-b27a-e951812db639 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] 10.222.0.87 "GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f" status: 200 len: 1261 microversion: 2.1 time: 0.143942 Oct 29 01:33:43.828861 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 374/740] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:33:43 2021] GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f => generated 1261 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:33:44.845423 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-77143171-1401-46dc-9c28-cfd7c25e6fba tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:44.846021 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-77143171-1401-46dc-9c28-cfd7c25e6fba tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] [instance: 58f3409d-cd2a-4bef-9ae4-2fba782b321f] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:33:44.852187 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-77143171-1401-46dc-9c28-cfd7c25e6fba tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:44.852626 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-77143171-1401-46dc-9c28-cfd7c25e6fba tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:44.853417 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-77143171-1401-46dc-9c28-cfd7c25e6fba tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:44.853835 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-77143171-1401-46dc-9c28-cfd7c25e6fba tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:45.029298 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-77143171-1401-46dc-9c28-cfd7c25e6fba tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c50a525003e427ba5ff9dea8f4ed47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0db42704249b29fba70abbda7991c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:45.037402 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-77143171-1401-46dc-9c28-cfd7c25e6fba tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] 10.222.0.87 "GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f" status: 200 len: 1261 microversion: 2.1 time: 0.196370 Oct 29 01:33:45.037962 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 367/741] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:33:44 2021] GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f => generated 1261 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:33:45.290895 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-ae0f3c20-716b-49ab-89bf-291a56b9278a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:45.291493 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-ae0f3c20-716b-49ab-89bf-291a56b9278a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:33:45.298051 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ae0f3c20-716b-49ab-89bf-291a56b9278a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:45.298496 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ae0f3c20-716b-49ab-89bf-291a56b9278a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:45.299261 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ae0f3c20-716b-49ab-89bf-291a56b9278a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:45.299692 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ae0f3c20-716b-49ab-89bf-291a56b9278a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:45.329418 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-ae0f3c20-716b-49ab-89bf-291a56b9278a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/os-volume_attachments/9f5e6ac9-2ee2-42c3-ab4c-9b94965d1dab" status: 200 len: 194 microversion: 2.20 time: 0.042339 Oct 29 01:33:45.330001 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 375/742] 10.222.0.87 () {60 vars in 1453 bytes} [Fri Oct 29 01:33:45 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/os-volume_attachments/9f5e6ac9-2ee2-42c3-ab4c-9b94965d1dab => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:33:45.392366 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-c3c9ef84-96da-4adc-a25d-08eaa8521a4b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:45.392865 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-c3c9ef84-96da-4adc-a25d-08eaa8521a4b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:33:45.398696 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-c3c9ef84-96da-4adc-a25d-08eaa8521a4b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:45.399131 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-c3c9ef84-96da-4adc-a25d-08eaa8521a4b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:45.399907 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-c3c9ef84-96da-4adc-a25d-08eaa8521a4b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:45.400332 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-c3c9ef84-96da-4adc-a25d-08eaa8521a4b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:45.478150 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.objects.instance [None req-c3c9ef84-96da-4adc-a25d-08eaa8521a4b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lazy-loading 'services' on Instance uuid f64f5ebf-8af1-4507-849e-b7d8e33979ae {{(pid=116379) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 01:33:45.715263 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-c3c9ef84-96da-4adc-a25d-08eaa8521a4b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "DELETE /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/os-volume_attachments/9f5e6ac9-2ee2-42c3-ab4c-9b94965d1dab" status: 202 len: 0 microversion: 2.20 time: 0.326961 Oct 29 01:33:45.715830 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 368/743] 10.222.0.87 () {60 vars in 1456 bytes} [Fri Oct 29 01:33:45 2021] DELETE /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/os-volume_attachments/9f5e6ac9-2ee2-42c3-ab4c-9b94965d1dab => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:33:45.725563 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-a861500c-d38b-4170-82d3-a18c7598bd67 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:45.729301 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-a861500c-d38b-4170-82d3-a18c7598bd67 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:33:45.732467 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a861500c-d38b-4170-82d3-a18c7598bd67 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:45.733463 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a861500c-d38b-4170-82d3-a18c7598bd67 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:45.734515 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a861500c-d38b-4170-82d3-a18c7598bd67 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:45.734953 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a861500c-d38b-4170-82d3-a18c7598bd67 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:45.765663 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-a861500c-d38b-4170-82d3-a18c7598bd67 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044956 Oct 29 01:33:45.766436 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 376/744] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Oct 29 01:33:45 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:33:46.054755 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-29c6f895-39c4-48cc-af1f-a3d6694a3726 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:46.055436 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-29c6f895-39c4-48cc-af1f-a3d6694a3726 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] [instance: 58f3409d-cd2a-4bef-9ae4-2fba782b321f] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:33:46.062564 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-29c6f895-39c4-48cc-af1f-a3d6694a3726 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:46.063003 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-29c6f895-39c4-48cc-af1f-a3d6694a3726 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:46.063782 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-29c6f895-39c4-48cc-af1f-a3d6694a3726 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:46.064209 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-29c6f895-39c4-48cc-af1f-a3d6694a3726 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:46.189593 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-29c6f895-39c4-48cc-af1f-a3d6694a3726 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c50a525003e427ba5ff9dea8f4ed47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0db42704249b29fba70abbda7991c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:46.197326 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-29c6f895-39c4-48cc-af1f-a3d6694a3726 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] 10.222.0.87 "GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f" status: 200 len: 1261 microversion: 2.1 time: 0.147068 Oct 29 01:33:46.203547 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 369/745] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:33:46 2021] GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f => generated 1261 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:33:46.779068 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-77b18316-40fd-41a5-b90d-fbdc39b52a9c tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:46.781395 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-77b18316-40fd-41a5-b90d-fbdc39b52a9c tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:33:46.792024 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-77b18316-40fd-41a5-b90d-fbdc39b52a9c tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:46.796566 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-77b18316-40fd-41a5-b90d-fbdc39b52a9c tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:46.796566 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-77b18316-40fd-41a5-b90d-fbdc39b52a9c tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:46.796566 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-77b18316-40fd-41a5-b90d-fbdc39b52a9c tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:46.823429 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-77b18316-40fd-41a5-b90d-fbdc39b52a9c tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049765 Oct 29 01:33:46.824053 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 377/746] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Oct 29 01:33:46 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:33:47.092438 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-37d17e9d-250a-4dbc-868e-584dea2e87d4 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:47.093504 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-37d17e9d-250a-4dbc-868e-584dea2e87d4 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:33:47.099784 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-37d17e9d-250a-4dbc-868e-584dea2e87d4 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:47.100239 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-37d17e9d-250a-4dbc-868e-584dea2e87d4 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:47.101012 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-37d17e9d-250a-4dbc-868e-584dea2e87d4 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:47.101442 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-37d17e9d-250a-4dbc-868e-584dea2e87d4 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:47.132291 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-37d17e9d-250a-4dbc-868e-584dea2e87d4 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043635 Oct 29 01:33:47.132858 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 370/747] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Oct 29 01:33:47 2021] GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:33:47.194184 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-7ab132b1-610a-4b91-bf54-51bac4d75eec tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:47.194662 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-7ab132b1-610a-4b91-bf54-51bac4d75eec tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:33:47.200973 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-7ab132b1-610a-4b91-bf54-51bac4d75eec tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:47.201654 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-7ab132b1-610a-4b91-bf54-51bac4d75eec tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:47.202829 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-7ab132b1-610a-4b91-bf54-51bac4d75eec tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:47.204066 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-7ab132b1-610a-4b91-bf54-51bac4d75eec tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:47.214947 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-4be91919-b236-4f54-895e-c8745153852e tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:47.215547 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-4be91919-b236-4f54-895e-c8745153852e tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] [instance: 58f3409d-cd2a-4bef-9ae4-2fba782b321f] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:33:47.222077 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-4be91919-b236-4f54-895e-c8745153852e tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:47.222522 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-4be91919-b236-4f54-895e-c8745153852e tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:47.223303 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-4be91919-b236-4f54-895e-c8745153852e tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:47.223755 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-4be91919-b236-4f54-895e-c8745153852e tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:47.238604 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-7ab132b1-610a-4b91-bf54-51bac4d75eec tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Going to try to terminate instance {{(pid=116378) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 29 01:33:47.367250 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-4be91919-b236-4f54-895e-c8745153852e tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c50a525003e427ba5ff9dea8f4ed47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0db42704249b29fba70abbda7991c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:47.375363 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-4be91919-b236-4f54-895e-c8745153852e tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] 10.222.0.87 "GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f" status: 200 len: 1445 microversion: 2.1 time: 0.163426 Oct 29 01:33:47.376161 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 371/748] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:33:47 2021] GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f => generated 1445 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:33:47.392221 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-942727f3-e6c6-4a87-8855-4b3f37859290 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:47.392824 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-942727f3-e6c6-4a87-8855-4b3f37859290 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] [instance: 58f3409d-cd2a-4bef-9ae4-2fba782b321f] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:33:47.398811 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-942727f3-e6c6-4a87-8855-4b3f37859290 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:47.399244 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-942727f3-e6c6-4a87-8855-4b3f37859290 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:47.400060 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-942727f3-e6c6-4a87-8855-4b3f37859290 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:47.400486 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-942727f3-e6c6-4a87-8855-4b3f37859290 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:47.532178 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-942727f3-e6c6-4a87-8855-4b3f37859290 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c50a525003e427ba5ff9dea8f4ed47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0db42704249b29fba70abbda7991c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:47.540342 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-942727f3-e6c6-4a87-8855-4b3f37859290 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] 10.222.0.87 "GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f" status: 200 len: 1445 microversion: 2.1 time: 0.152278 Oct 29 01:33:47.542512 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 372/749] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:33:47 2021] GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f => generated 1445 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:33:47.613978 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-7ab132b1-610a-4b91-bf54-51bac4d75eec tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "DELETE /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92" status: 204 len: 0 microversion: 2.1 time: 0.423146 Oct 29 01:33:47.614935 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 378/750] 10.222.0.87 () {58 vars in 1238 bytes} [Fri Oct 29 01:33:47 2021] DELETE /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:33:47.623106 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-d870483f-b9dc-4059-85c0-61e20293b8da tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:47.623711 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-d870483f-b9dc-4059-85c0-61e20293b8da tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:33:47.630535 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d870483f-b9dc-4059-85c0-61e20293b8da tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:47.630989 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d870483f-b9dc-4059-85c0-61e20293b8da tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:47.631783 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d870483f-b9dc-4059-85c0-61e20293b8da tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:47.632218 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d870483f-b9dc-4059-85c0-61e20293b8da tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:47.782535 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-d870483f-b9dc-4059-85c0-61e20293b8da tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045dda1ff9b44334954c08e63fcd20c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51a2093a0874d52a08f6e25489ba181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:47.790434 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-d870483f-b9dc-4059-85c0-61e20293b8da tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92" status: 200 len: 1674 microversion: 2.1 time: 0.170943 Oct 29 01:33:47.791007 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 373/751] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:33:47 2021] GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92 => generated 1674 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:33:47.835477 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-5577e76e-428e-4716-bd5f-5641c3fdaf42 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:47.836428 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-5577e76e-428e-4716-bd5f-5641c3fdaf42 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:33:47.842721 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-5577e76e-428e-4716-bd5f-5641c3fdaf42 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:47.846471 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-5577e76e-428e-4716-bd5f-5641c3fdaf42 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:47.846471 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-5577e76e-428e-4716-bd5f-5641c3fdaf42 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:47.846471 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-5577e76e-428e-4716-bd5f-5641c3fdaf42 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:47.874229 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-5577e76e-428e-4716-bd5f-5641c3fdaf42 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042921 Oct 29 01:33:47.875277 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 379/752] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Oct 29 01:33:47 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:33:47.933379 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-964da911-681a-4001-bc6c-293b1b68e43a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:47.933869 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-964da911-681a-4001-bc6c-293b1b68e43a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:33:47.939868 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-964da911-681a-4001-bc6c-293b1b68e43a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:47.940310 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-964da911-681a-4001-bc6c-293b1b68e43a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:47.941074 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-964da911-681a-4001-bc6c-293b1b68e43a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:47.941500 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-964da911-681a-4001-bc6c-293b1b68e43a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:47.966283 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-964da911-681a-4001-bc6c-293b1b68e43a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Going to try to terminate instance {{(pid=116379) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 29 01:33:48.264453 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-964da911-681a-4001-bc6c-293b1b68e43a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "DELETE /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 204 len: 0 microversion: 2.20 time: 0.334399 Oct 29 01:33:48.265665 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 374/753] 10.222.0.87 () {60 vars in 1279 bytes} [Fri Oct 29 01:33:47 2021] DELETE /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 01:33:48.273693 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-76ed8875-fe12-457a-a5d8-964150f4f3ef tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:48.274383 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-76ed8875-fe12-457a-a5d8-964150f4f3ef tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:33:48.281400 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-76ed8875-fe12-457a-a5d8-964150f4f3ef tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:48.282011 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-76ed8875-fe12-457a-a5d8-964150f4f3ef tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:48.282934 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-76ed8875-fe12-457a-a5d8-964150f4f3ef tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:48.283504 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-76ed8875-fe12-457a-a5d8-964150f4f3ef tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:48.484201 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-76ed8875-fe12-457a-a5d8-964150f4f3ef tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:48.495828 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-76ed8875-fe12-457a-a5d8-964150f4f3ef tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:48.497829 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-76ed8875-fe12-457a-a5d8-964150f4f3ef tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:48.499024 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-76ed8875-fe12-457a-a5d8-964150f4f3ef tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1723 microversion: 2.20 time: 0.229009 Oct 29 01:33:48.500174 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 380/754] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:33:48 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1723 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:33:48.580976 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-deccd841-1ab3-4cc0-a650-4e16852806a4 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-395405783", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1481000100", "security_groups": [{"name": "tempest-secgroup-smoke-1031308803"}], "block_device_mapping_v2": [{"uuid": "84cb3b7b-67e3-4a86-9a3e-81e0be88681f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b37af5eb-5268-42f9-a4b9-3756fed9194f"}]}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:33:48.725636 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.network.neutron [None req-deccd841-1ab3-4cc0-a650-4e16852806a4 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] validate_networks() for [('b37af5eb-5268-42f9-a4b9-3756fed9194f', None, None, None, None, None)] {{(pid=116379) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 29 01:33:48.808049 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-53b60712-44a8-4926-b9a8-4b8f9877ea64 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:48.808649 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-53b60712-44a8-4926-b9a8-4b8f9877ea64 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:33:48.815112 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-53b60712-44a8-4926-b9a8-4b8f9877ea64 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:48.815547 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-53b60712-44a8-4926-b9a8-4b8f9877ea64 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:48.817484 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-53b60712-44a8-4926-b9a8-4b8f9877ea64 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:48.817484 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-53b60712-44a8-4926-b9a8-4b8f9877ea64 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:49.160476 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-53b60712-44a8-4926-b9a8-4b8f9877ea64 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045dda1ff9b44334954c08e63fcd20c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51a2093a0874d52a08f6e25489ba181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:49.168880 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-53b60712-44a8-4926-b9a8-4b8f9877ea64 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92" status: 200 len: 1674 microversion: 2.1 time: 0.364541 Oct 29 01:33:49.177229 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 381/755] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:33:48 2021] GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92 => generated 1674 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:33:49.429604 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.virt.hardware [None req-deccd841-1ab3-4cc0-a650-4e16852806a4 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Flavor limits 0:0:0 {{(pid=116379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:33:49.430062 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.virt.hardware [None req-deccd841-1ab3-4cc0-a650-4e16852806a4 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Image limits 0:0:0 {{(pid=116379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:33:49.430673 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.virt.hardware [None req-deccd841-1ab3-4cc0-a650-4e16852806a4 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Flavor pref 0:0:0 {{(pid=116379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:33:49.431088 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.virt.hardware [None req-deccd841-1ab3-4cc0-a650-4e16852806a4 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Image pref 0:0:0 {{(pid=116379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:33:49.431500 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.virt.hardware [None req-deccd841-1ab3-4cc0-a650-4e16852806a4 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:33:49.441180 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-deccd841-1ab3-4cc0-a650-4e16852806a4 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:49.441632 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-deccd841-1ab3-4cc0-a650-4e16852806a4 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:49.442435 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-deccd841-1ab3-4cc0-a650-4e16852806a4 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:49.442871 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-deccd841-1ab3-4cc0-a650-4e16852806a4 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:49.460836 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.quota [None req-deccd841-1ab3-4cc0-a650-4e16852806a4 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Getting quotas for project 84bceeeb4f67456a90779360ffc620aa. Resources: {'instances', 'cores', 'ram'} {{(pid=116379) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 01:33:49.464772 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.quota [None req-deccd841-1ab3-4cc0-a650-4e16852806a4 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Getting quotas for user bef8571ef39b4efe8f510a28052e2b6f and project 84bceeeb4f67456a90779360ffc620aa. Resources: {'instances', 'cores', 'ram'} {{(pid=116379) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 01:33:49.518544 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-c40d6d47-a7b3-48bc-80fa-3858a03e1dd3 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:49.526183 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-c40d6d47-a7b3-48bc-80fa-3858a03e1dd3 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:33:49.526524 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-deccd841-1ab3-4cc0-a650-4e16852806a4 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Going to run 1 instances... {{(pid=116379) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 29 01:33:49.526630 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c40d6d47-a7b3-48bc-80fa-3858a03e1dd3 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:49.526739 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-deccd841-1ab3-4cc0-a650-4e16852806a4 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] [instance: f69664c9-6a0c-4807-a429-f39a1823f6ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='84cb3b7b-67e3-4a86-9a3e-81e0be88681f',volume_size=None,volume_type=None)] {{(pid=116379) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 29 01:33:49.526851 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c40d6d47-a7b3-48bc-80fa-3858a03e1dd3 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:49.527662 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c40d6d47-a7b3-48bc-80fa-3858a03e1dd3 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:49.528175 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c40d6d47-a7b3-48bc-80fa-3858a03e1dd3 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:49.664331 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-c40d6d47-a7b3-48bc-80fa-3858a03e1dd3 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:49.673521 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-c40d6d47-a7b3-48bc-80fa-3858a03e1dd3 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:49.697406 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-c40d6d47-a7b3-48bc-80fa-3858a03e1dd3 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:49.697406 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-c40d6d47-a7b3-48bc-80fa-3858a03e1dd3 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1723 microversion: 2.20 time: 0.162052 Oct 29 01:33:49.697406 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 382/756] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:33:49 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:33:50.026748 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-deccd841-1ab3-4cc0-a650-4e16852806a4 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.450680 Oct 29 01:33:50.027409 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 375/757] 10.222.0.87 () {60 vars in 1146 bytes} [Fri Oct 29 01:33:48 2021] POST /compute/v2.1/servers => generated 406 bytes in 1452 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:33:50.038558 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-3955a5e7-ead0-4d91-87eb-36d5a08906eb tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:50.038558 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-3955a5e7-ead0-4d91-87eb-36d5a08906eb tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] [instance: f69664c9-6a0c-4807-a429-f39a1823f6ac] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:33:50.110067 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-3955a5e7-ead0-4d91-87eb-36d5a08906eb tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef8571ef39b4efe8f510a28052e2b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84bceeeb4f67456a90779360ffc620aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:50.117437 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-3955a5e7-ead0-4d91-87eb-36d5a08906eb tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] 10.222.0.87 "GET /compute/v2.1/servers/f69664c9-6a0c-4807-a429-f39a1823f6ac" status: 200 len: 1094 microversion: 2.1 time: 0.082756 Oct 29 01:33:50.118339 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 383/758] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:33:50 2021] GET /compute/v2.1/servers/f69664c9-6a0c-4807-a429-f39a1823f6ac => generated 1094 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:33:50.187137 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-9dc53b4d-49aa-4e61-9822-98bcafe2f8b1 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:50.188502 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-9dc53b4d-49aa-4e61-9822-98bcafe2f8b1 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:33:50.195305 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-9dc53b4d-49aa-4e61-9822-98bcafe2f8b1 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:50.195867 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-9dc53b4d-49aa-4e61-9822-98bcafe2f8b1 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:50.196712 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-9dc53b4d-49aa-4e61-9822-98bcafe2f8b1 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:50.197218 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-9dc53b4d-49aa-4e61-9822-98bcafe2f8b1 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:50.354393 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-9dc53b4d-49aa-4e61-9822-98bcafe2f8b1 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045dda1ff9b44334954c08e63fcd20c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51a2093a0874d52a08f6e25489ba181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:50.363079 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-9dc53b4d-49aa-4e61-9822-98bcafe2f8b1 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92" status: 200 len: 1674 microversion: 2.1 time: 0.180362 Oct 29 01:33:50.364197 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 376/759] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:33:50 2021] GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92 => generated 1674 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:33:50.418900 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [req-8701bb43-37ff-40ac-ae77-62c9552d69b9 req-e4fe909b-7388-4afc-9a36-5550428e27a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58f3409d-cd2a-4bef-9ae4-2fba782b321f", "tag": "b9061b77-a5c8-4ac6-9f65-0f8712ee20cf"}]} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:33:50.420785 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:33:50.420785 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: warnings.warn(msg) Oct 29 01:33:50.433086 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [req-8701bb43-37ff-40ac-ae77-62c9552d69b9 req-e4fe909b-7388-4afc-9a36-5550428e27a8 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:50.433758 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [req-8701bb43-37ff-40ac-ae77-62c9552d69b9 req-e4fe909b-7388-4afc-9a36-5550428e27a8 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:50.445266 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.compute.server_external_events [req-8701bb43-37ff-40ac-ae77-62c9552d69b9 req-e4fe909b-7388-4afc-9a36-5550428e27a8 service nova] Creating event network-changed:b9061b77-a5c8-4ac6-9f65-0f8712ee20cf for instance 58f3409d-cd2a-4bef-9ae4-2fba782b321f on hv-cinder-81398 Oct 29 01:33:50.451588 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [req-8701bb43-37ff-40ac-ae77-62c9552d69b9 req-e4fe909b-7388-4afc-9a36-5550428e27a8 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036322 Oct 29 01:33:50.453807 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 384/760] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Oct 29 01:33:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:33:50.695236 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-e161b15b-04e8-4f5a-8044-38542c464ccf tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:50.698400 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-e161b15b-04e8-4f5a-8044-38542c464ccf tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:33:50.703332 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-e161b15b-04e8-4f5a-8044-38542c464ccf tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:50.704262 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-e161b15b-04e8-4f5a-8044-38542c464ccf tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:50.705061 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-e161b15b-04e8-4f5a-8044-38542c464ccf tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:50.705499 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-e161b15b-04e8-4f5a-8044-38542c464ccf tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:51.007847 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-e161b15b-04e8-4f5a-8044-38542c464ccf tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:51.019485 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-e161b15b-04e8-4f5a-8044-38542c464ccf tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:51.026060 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-e161b15b-04e8-4f5a-8044-38542c464ccf tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:51.031863 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-e161b15b-04e8-4f5a-8044-38542c464ccf tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1723 microversion: 2.20 time: 0.340455 Oct 29 01:33:51.033016 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 377/761] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:33:50 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1723 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:33:51.138036 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-733491de-f778-4abd-9508-bb90cdcde41c tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:51.139043 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-733491de-f778-4abd-9508-bb90cdcde41c tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] [instance: f69664c9-6a0c-4807-a429-f39a1823f6ac] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:33:51.227944 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-733491de-f778-4abd-9508-bb90cdcde41c tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef8571ef39b4efe8f510a28052e2b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84bceeeb4f67456a90779360ffc620aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:51.240484 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-733491de-f778-4abd-9508-bb90cdcde41c tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] 10.222.0.87 "GET /compute/v2.1/servers/f69664c9-6a0c-4807-a429-f39a1823f6ac" status: 200 len: 1094 microversion: 2.1 time: 0.107549 Oct 29 01:33:51.242239 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 385/762] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:33:51 2021] GET /compute/v2.1/servers/f69664c9-6a0c-4807-a429-f39a1823f6ac => generated 1094 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:33:51.386013 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-7981c4ff-f593-4771-80fc-df6ded438d13 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:51.389322 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-7981c4ff-f593-4771-80fc-df6ded438d13 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:33:51.395430 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-7981c4ff-f593-4771-80fc-df6ded438d13 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:51.395917 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-7981c4ff-f593-4771-80fc-df6ded438d13 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:51.397317 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-7981c4ff-f593-4771-80fc-df6ded438d13 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:51.397932 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-7981c4ff-f593-4771-80fc-df6ded438d13 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:51.784918 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-7981c4ff-f593-4771-80fc-df6ded438d13 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045dda1ff9b44334954c08e63fcd20c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51a2093a0874d52a08f6e25489ba181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:51.794040 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-7981c4ff-f593-4771-80fc-df6ded438d13 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92" status: 200 len: 1674 microversion: 2.1 time: 0.416063 Oct 29 01:33:51.794625 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 378/763] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:33:51 2021] GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92 => generated 1674 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:33:52.050527 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-13296118-e479-4cac-b16a-513eca7ab679 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:52.051375 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-13296118-e479-4cac-b16a-513eca7ab679 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:33:52.057693 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-13296118-e479-4cac-b16a-513eca7ab679 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:52.061435 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-13296118-e479-4cac-b16a-513eca7ab679 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:52.061435 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-13296118-e479-4cac-b16a-513eca7ab679 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:52.061435 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-13296118-e479-4cac-b16a-513eca7ab679 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:52.174324 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-13296118-e479-4cac-b16a-513eca7ab679 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:52.182524 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-13296118-e479-4cac-b16a-513eca7ab679 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:52.187416 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-13296118-e479-4cac-b16a-513eca7ab679 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:52.188632 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-13296118-e479-4cac-b16a-513eca7ab679 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1656 microversion: 2.20 time: 0.141805 Oct 29 01:33:52.189686 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 386/764] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:33:52 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1656 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:33:52.263050 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-f4d7a5f6-a19d-49de-87d8-d301e7fa07d6 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:52.263674 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-f4d7a5f6-a19d-49de-87d8-d301e7fa07d6 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] [instance: f69664c9-6a0c-4807-a429-f39a1823f6ac] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:33:52.276414 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-f4d7a5f6-a19d-49de-87d8-d301e7fa07d6 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:52.276873 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-f4d7a5f6-a19d-49de-87d8-d301e7fa07d6 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:52.282908 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-f4d7a5f6-a19d-49de-87d8-d301e7fa07d6 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:52.283592 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-f4d7a5f6-a19d-49de-87d8-d301e7fa07d6 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:52.377787 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [req-eb3cdde0-4231-4ed9-8648-59701c8926a6 req-b931fc8c-2e50-4f26-99e3-adb125630d7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f64f5ebf-8af1-4507-849e-b7d8e33979ae", "name": "network-vif-deleted", "tag": "01153800-bf44-4376-854e-aec24743a4d7"}]} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:33:52.379956 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:33:52.379956 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: warnings.warn(msg) Oct 29 01:33:52.402596 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [req-eb3cdde0-4231-4ed9-8648-59701c8926a6 req-b931fc8c-2e50-4f26-99e3-adb125630d7c service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:52.403092 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [req-eb3cdde0-4231-4ed9-8648-59701c8926a6 req-b931fc8c-2e50-4f26-99e3-adb125630d7c service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:52.418734 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.compute.server_external_events [req-eb3cdde0-4231-4ed9-8648-59701c8926a6 req-b931fc8c-2e50-4f26-99e3-adb125630d7c service nova] Creating event network-vif-deleted:01153800-bf44-4376-854e-aec24743a4d7 for instance f64f5ebf-8af1-4507-849e-b7d8e33979ae on hv-cinder-81398 Oct 29 01:33:52.426274 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [req-eb3cdde0-4231-4ed9-8648-59701c8926a6 req-b931fc8c-2e50-4f26-99e3-adb125630d7c service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052756 Oct 29 01:33:52.428470 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 387/765] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Oct 29 01:33:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:33:52.435933 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-f4d7a5f6-a19d-49de-87d8-d301e7fa07d6 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef8571ef39b4efe8f510a28052e2b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84bceeeb4f67456a90779360ffc620aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:52.463947 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-f4d7a5f6-a19d-49de-87d8-d301e7fa07d6 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] 10.222.0.87 "GET /compute/v2.1/servers/f69664c9-6a0c-4807-a429-f39a1823f6ac" status: 200 len: 1192 microversion: 2.1 time: 0.199199 Oct 29 01:33:52.464932 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 379/766] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:33:52 2021] GET /compute/v2.1/servers/f69664c9-6a0c-4807-a429-f39a1823f6ac => generated 1192 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:33:52.564382 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [req-90539cb7-1e24-4a5a-b4c1-a3e01bea1446 req-88bd1e21-b482-4fdd-9078-32e9fcd0a724 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cc2f3ec-53ba-4b8c-a02a-236f8564eb92", "name": "network-vif-deleted", "tag": "d40854b4-c7cf-4c79-ba60-0ea2a73669e5"}]} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:33:52.566148 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:33:52.566148 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: warnings.warn(msg) Oct 29 01:33:52.574717 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [req-90539cb7-1e24-4a5a-b4c1-a3e01bea1446 req-88bd1e21-b482-4fdd-9078-32e9fcd0a724 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:52.575488 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [req-90539cb7-1e24-4a5a-b4c1-a3e01bea1446 req-88bd1e21-b482-4fdd-9078-32e9fcd0a724 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:52.595398 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.compute.server_external_events [req-90539cb7-1e24-4a5a-b4c1-a3e01bea1446 req-88bd1e21-b482-4fdd-9078-32e9fcd0a724 service nova] Creating event network-vif-deleted:d40854b4-c7cf-4c79-ba60-0ea2a73669e5 for instance 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92 on hv-cinder-81398 Oct 29 01:33:52.607838 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [req-90539cb7-1e24-4a5a-b4c1-a3e01bea1446 req-88bd1e21-b482-4fdd-9078-32e9fcd0a724 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048417 Oct 29 01:33:52.612717 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 388/767] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Oct 29 01:33:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:33:52.821107 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-26be2a44-87d9-404b-a570-442ab9a8c459 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:52.822404 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-26be2a44-87d9-404b-a570-442ab9a8c459 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:33:52.838341 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-26be2a44-87d9-404b-a570-442ab9a8c459 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:52.839655 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-26be2a44-87d9-404b-a570-442ab9a8c459 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:52.842916 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-26be2a44-87d9-404b-a570-442ab9a8c459 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:52.844357 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-26be2a44-87d9-404b-a570-442ab9a8c459 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:52.958560 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-26be2a44-87d9-404b-a570-442ab9a8c459 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045dda1ff9b44334954c08e63fcd20c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51a2093a0874d52a08f6e25489ba181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:52.970895 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-26be2a44-87d9-404b-a570-442ab9a8c459 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92" status: 200 len: 1323 microversion: 2.1 time: 0.162116 Oct 29 01:33:52.971662 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 380/768] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:33:52 2021] GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92 => generated 1323 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:33:53.210786 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-75a2339d-6031-4c13-a0cb-ac39000a9596 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:53.217386 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-75a2339d-6031-4c13-a0cb-ac39000a9596 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:33:53.233035 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-75a2339d-6031-4c13-a0cb-ac39000a9596 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:53.235268 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-75a2339d-6031-4c13-a0cb-ac39000a9596 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:53.238432 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-75a2339d-6031-4c13-a0cb-ac39000a9596 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:53.238909 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-75a2339d-6031-4c13-a0cb-ac39000a9596 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:53.336365 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-75a2339d-6031-4c13-a0cb-ac39000a9596 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:53.337266 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-75a2339d-6031-4c13-a0cb-ac39000a9596 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:53.339070 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.objects.instance [None req-75a2339d-6031-4c13-a0cb-ac39000a9596 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lazy-loading 'fault' on Instance uuid f64f5ebf-8af1-4507-849e-b7d8e33979ae {{(pid=116378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 01:33:53.411054 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-75a2339d-6031-4c13-a0cb-ac39000a9596 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:53.427512 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-75a2339d-6031-4c13-a0cb-ac39000a9596 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:53.429120 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-75a2339d-6031-4c13-a0cb-ac39000a9596 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:53.431894 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-75a2339d-6031-4c13-a0cb-ac39000a9596 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 200 len: 1371 microversion: 2.20 time: 0.227028 Oct 29 01:33:53.440443 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 389/769] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:33:53 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 1371 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:33:53.474078 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-7eb1a90b-da5a-4cf8-8064-52f5f2c65af5 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:53.474929 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-7eb1a90b-da5a-4cf8-8064-52f5f2c65af5 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] [instance: f69664c9-6a0c-4807-a429-f39a1823f6ac] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:33:53.482429 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-7eb1a90b-da5a-4cf8-8064-52f5f2c65af5 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:53.482825 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-7eb1a90b-da5a-4cf8-8064-52f5f2c65af5 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:53.485100 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-7eb1a90b-da5a-4cf8-8064-52f5f2c65af5 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:53.485100 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-7eb1a90b-da5a-4cf8-8064-52f5f2c65af5 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:53.600331 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-7eb1a90b-da5a-4cf8-8064-52f5f2c65af5 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef8571ef39b4efe8f510a28052e2b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84bceeeb4f67456a90779360ffc620aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:53.612490 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-7eb1a90b-da5a-4cf8-8064-52f5f2c65af5 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] 10.222.0.87 "GET /compute/v2.1/servers/f69664c9-6a0c-4807-a429-f39a1823f6ac" status: 200 len: 1210 microversion: 2.1 time: 0.142450 Oct 29 01:33:53.615420 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 381/770] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:33:53 2021] GET /compute/v2.1/servers/f69664c9-6a0c-4807-a429-f39a1823f6ac => generated 1210 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:33:53.990293 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-440d4507-66f6-4102-a160-2e491c26f072 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:53.991128 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-440d4507-66f6-4102-a160-2e491c26f072 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:33:53.998877 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-440d4507-66f6-4102-a160-2e491c26f072 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:53.999325 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-440d4507-66f6-4102-a160-2e491c26f072 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:54.000181 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-440d4507-66f6-4102-a160-2e491c26f072 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:54.002773 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-440d4507-66f6-4102-a160-2e491c26f072 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:54.047314 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-440d4507-66f6-4102-a160-2e491c26f072 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:54.048130 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-440d4507-66f6-4102-a160-2e491c26f072 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:54.048796 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.objects.instance [None req-440d4507-66f6-4102-a160-2e491c26f072 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lazy-loading 'fault' on Instance uuid 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92 {{(pid=116378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 01:33:54.129932 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-440d4507-66f6-4102-a160-2e491c26f072 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045dda1ff9b44334954c08e63fcd20c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51a2093a0874d52a08f6e25489ba181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:54.137414 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-440d4507-66f6-4102-a160-2e491c26f072 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92" status: 200 len: 1328 microversion: 2.1 time: 0.153258 Oct 29 01:33:54.137997 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 390/771] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:33:53 2021] GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92 => generated 1328 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:33:54.453307 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-d3194172-e3b1-46f6-939e-86731d766dca tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:54.453917 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-d3194172-e3b1-46f6-939e-86731d766dca tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:33:54.460348 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d3194172-e3b1-46f6-939e-86731d766dca tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:54.461169 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d3194172-e3b1-46f6-939e-86731d766dca tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:54.462389 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d3194172-e3b1-46f6-939e-86731d766dca tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:54.462822 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d3194172-e3b1-46f6-939e-86731d766dca tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:54.478343 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.wsgi [None req-d3194172-e3b1-46f6-939e-86731d766dca tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] HTTP exception thrown: Instance f64f5ebf-8af1-4507-849e-b7d8e33979ae could not be found. Oct 29 01:33:54.479197 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-d3194172-e3b1-46f6-939e-86731d766dca tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Returning 404 to user: Instance f64f5ebf-8af1-4507-849e-b7d8e33979ae could not be found. {{(pid=116379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:33:54.480240 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-d3194172-e3b1-46f6-939e-86731d766dca tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 404 len: 111 microversion: 2.20 time: 0.031630 Oct 29 01:33:54.480969 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 382/772] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:33:54 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 01:33:54.490043 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-b063ec74-94e2-4661-9e11-2280d8f0a095 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '.version_select at 0x7ff62c0c2430>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:54.635997 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-c4ee84cd-07c0-4f8e-8e8c-d33f7b4209dd tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:54.636590 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-c4ee84cd-07c0-4f8e-8e8c-d33f7b4209dd tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] [instance: f69664c9-6a0c-4807-a429-f39a1823f6ac] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:33:54.638444 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-b063ec74-94e2-4661-9e11-2280d8f0a095 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-668136227" status: 204 len: 0 microversion: 2.20 time: 0.151930 Oct 29 01:33:54.639833 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 391/773] 10.222.0.87 () {60 vars in 1258 bytes} [Fri Oct 29 01:33:54 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-668136227 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 01:33:54.649105 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-c4ee84cd-07c0-4f8e-8e8c-d33f7b4209dd tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:54.649560 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-c4ee84cd-07c0-4f8e-8e8c-d33f7b4209dd tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:54.650335 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-c4ee84cd-07c0-4f8e-8e8c-d33f7b4209dd tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:54.650932 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-c4ee84cd-07c0-4f8e-8e8c-d33f7b4209dd tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:54.969622 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-c4ee84cd-07c0-4f8e-8e8c-d33f7b4209dd tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef8571ef39b4efe8f510a28052e2b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84bceeeb4f67456a90779360ffc620aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:54.985582 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-c4ee84cd-07c0-4f8e-8e8c-d33f7b4209dd tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] 10.222.0.87 "GET /compute/v2.1/servers/f69664c9-6a0c-4807-a429-f39a1823f6ac" status: 200 len: 1278 microversion: 2.1 time: 0.353995 Oct 29 01:33:54.986187 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 383/774] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:33:54 2021] GET /compute/v2.1/servers/f69664c9-6a0c-4807-a429-f39a1823f6ac => generated 1278 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:33:55.156770 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-24714786-a8ab-43d3-aace-146d7a8139ce tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:55.157353 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-24714786-a8ab-43d3-aace-146d7a8139ce tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:33:55.163480 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-24714786-a8ab-43d3-aace-146d7a8139ce tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:55.164172 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-24714786-a8ab-43d3-aace-146d7a8139ce tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:55.170432 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-24714786-a8ab-43d3-aace-146d7a8139ce tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:55.170432 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-24714786-a8ab-43d3-aace-146d7a8139ce tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:55.182933 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.wsgi [None req-24714786-a8ab-43d3-aace-146d7a8139ce tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] HTTP exception thrown: Instance 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92 could not be found. Oct 29 01:33:55.183507 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-24714786-a8ab-43d3-aace-146d7a8139ce tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Returning 404 to user: Instance 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92 could not be found. {{(pid=116378) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:33:55.184357 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-24714786-a8ab-43d3-aace-146d7a8139ce tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92" status: 404 len: 111 microversion: 2.1 time: 0.031823 Oct 29 01:33:55.185282 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 392/775] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:33:55 2021] GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:33:55.201962 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-9239a85d-5106-4a51-87b9-a3d67355f427 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '.version_select at 0x7ff62c047430>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:55.430266 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-9239a85d-5106-4a51-87b9-a3d67355f427 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1364222965" status: 202 len: 0 microversion: 2.1 time: 0.233932 Oct 29 01:33:55.435109 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 384/776] 10.222.0.87 () {58 vars in 1220 bytes} [Fri Oct 29 01:33:55 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1364222965 => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:33:55.798332 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-6fe78fd9-51db-4b5f-8317-b4b2270061d4 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Action: 'create', calling method: .version_select at 0x7ff62c0c2430>, body: {"keypair": {"name": "tempest-keypair-876787345"}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:33:55.817584 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.quota [None req-6fe78fd9-51db-4b5f-8317-b4b2270061d4 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Getting quotas for project 413ce1a7d8504d0b9f656d9e623f9005. Resources: {'key_pairs'} {{(pid=116378) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 01:33:55.821703 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.quota [None req-6fe78fd9-51db-4b5f-8317-b4b2270061d4 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Getting quotas for user 78823bdcff4e45d8ab82558b434f188d and project 413ce1a7d8504d0b9f656d9e623f9005. Resources: {'key_pairs'} {{(pid=116378) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 01:33:56.003009 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-988e8adf-a606-49da-a5dc-4c400b1316c5 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:56.004368 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-988e8adf-a606-49da-a5dc-4c400b1316c5 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] [instance: f69664c9-6a0c-4807-a429-f39a1823f6ac] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:33:56.014789 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-988e8adf-a606-49da-a5dc-4c400b1316c5 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:56.019190 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-988e8adf-a606-49da-a5dc-4c400b1316c5 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:56.019190 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-988e8adf-a606-49da-a5dc-4c400b1316c5 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:56.019190 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-988e8adf-a606-49da-a5dc-4c400b1316c5 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:56.119693 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.quota [None req-6fe78fd9-51db-4b5f-8317-b4b2270061d4 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Getting quotas for project 413ce1a7d8504d0b9f656d9e623f9005. Resources: {'key_pairs'} {{(pid=116378) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 01:33:56.124393 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.quota [None req-6fe78fd9-51db-4b5f-8317-b4b2270061d4 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Getting quotas for user 78823bdcff4e45d8ab82558b434f188d and project 413ce1a7d8504d0b9f656d9e623f9005. Resources: {'key_pairs'} {{(pid=116378) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 01:33:56.146758 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-6fe78fd9-51db-4b5f-8317-b4b2270061d4 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 0.352547 Oct 29 01:33:56.147944 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 393/777] 10.222.0.87 () {62 vars in 1198 bytes} [Fri Oct 29 01:33:55 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 355 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Oct 29 01:33:56.156146 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [req-3f4d7e85-7efd-409c-af4d-7608dae299b3 req-05e991ef-ecec-4d1b-9365-762361db2276 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f69664c9-6a0c-4807-a429-f39a1823f6ac", "tag": "569ffd45-8958-4842-9d3e-75bdbaf74160"}]} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:33:56.161582 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:33:56.161582 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: warnings.warn(msg) Oct 29 01:33:56.192178 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [req-3f4d7e85-7efd-409c-af4d-7608dae299b3 req-05e991ef-ecec-4d1b-9365-762361db2276 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:56.192993 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [req-3f4d7e85-7efd-409c-af4d-7608dae299b3 req-05e991ef-ecec-4d1b-9365-762361db2276 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:56.215719 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.compute.server_external_events [req-3f4d7e85-7efd-409c-af4d-7608dae299b3 req-05e991ef-ecec-4d1b-9365-762361db2276 service nova] Creating event network-changed:569ffd45-8958-4842-9d3e-75bdbaf74160 for instance f69664c9-6a0c-4807-a429-f39a1823f6ac on hv-cinder-81398 Oct 29 01:33:56.225062 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [req-3f4d7e85-7efd-409c-af4d-7608dae299b3 req-05e991ef-ecec-4d1b-9365-762361db2276 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072499 Oct 29 01:33:56.225062 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 394/778] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Oct 29 01:33:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:33:56.394084 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-988e8adf-a606-49da-a5dc-4c400b1316c5 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef8571ef39b4efe8f510a28052e2b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84bceeeb4f67456a90779360ffc620aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:56.414017 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-988e8adf-a606-49da-a5dc-4c400b1316c5 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] 10.222.0.87 "GET /compute/v2.1/servers/f69664c9-6a0c-4807-a429-f39a1823f6ac" status: 200 len: 1266 microversion: 2.1 time: 0.415018 Oct 29 01:33:56.416600 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 385/779] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:33:55 2021] GET /compute/v2.1/servers/f69664c9-6a0c-4807-a429-f39a1823f6ac => generated 1266 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:33:56.736489 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-b1b78edf-78b5-45ab-91d3-59c89b63a86c tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Action: 'create', calling method: .version_select at 0x7ff62c122700>, body: {"keypair": {"name": "tempest-keypair-522909088"}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:33:56.755109 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.quota [None req-b1b78edf-78b5-45ab-91d3-59c89b63a86c tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Getting quotas for project c51a2093a0874d52a08f6e25489ba181. Resources: {'key_pairs'} {{(pid=116378) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 01:33:56.759411 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.quota [None req-b1b78edf-78b5-45ab-91d3-59c89b63a86c tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Getting quotas for user 045dda1ff9b44334954c08e63fcd20c0 and project c51a2093a0874d52a08f6e25489ba181. Resources: {'key_pairs'} {{(pid=116378) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 01:33:57.187649 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.quota [None req-b1b78edf-78b5-45ab-91d3-59c89b63a86c tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Getting quotas for project c51a2093a0874d52a08f6e25489ba181. Resources: {'key_pairs'} {{(pid=116378) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 01:33:57.191256 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.quota [None req-b1b78edf-78b5-45ab-91d3-59c89b63a86c tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Getting quotas for user 045dda1ff9b44334954c08e63fcd20c0 and project c51a2093a0874d52a08f6e25489ba181. Resources: {'key_pairs'} {{(pid=116378) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 01:33:57.205691 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-b1b78edf-78b5-45ab-91d3-59c89b63a86c tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.474513 Oct 29 01:33:57.206251 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 395/780] 10.222.0.87 () {60 vars in 1157 bytes} [Fri Oct 29 01:33:56 2021] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:33:57.433316 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-23efb888-1d8c-41d4-8e43-e9cbf461cb44 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:57.433907 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-23efb888-1d8c-41d4-8e43-e9cbf461cb44 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] [instance: f69664c9-6a0c-4807-a429-f39a1823f6ac] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:33:57.440974 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-23efb888-1d8c-41d4-8e43-e9cbf461cb44 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:57.441418 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-23efb888-1d8c-41d4-8e43-e9cbf461cb44 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:57.442208 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-23efb888-1d8c-41d4-8e43-e9cbf461cb44 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:57.442618 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-23efb888-1d8c-41d4-8e43-e9cbf461cb44 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:57.584776 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-23efb888-1d8c-41d4-8e43-e9cbf461cb44 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef8571ef39b4efe8f510a28052e2b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84bceeeb4f67456a90779360ffc620aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:57.592329 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-23efb888-1d8c-41d4-8e43-e9cbf461cb44 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] 10.222.0.87 "GET /compute/v2.1/servers/f69664c9-6a0c-4807-a429-f39a1823f6ac" status: 200 len: 1266 microversion: 2.1 time: 0.162966 Oct 29 01:33:57.593046 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 386/781] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:33:57 2021] GET /compute/v2.1/servers/f69664c9-6a0c-4807-a429-f39a1823f6ac => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:33:58.610420 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-b312f9d9-5e6d-4c3e-b2c8-820f00848e4c tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:58.611141 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-b312f9d9-5e6d-4c3e-b2c8-820f00848e4c tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] [instance: f69664c9-6a0c-4807-a429-f39a1823f6ac] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:33:58.617621 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-b312f9d9-5e6d-4c3e-b2c8-820f00848e4c tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:58.618272 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-b312f9d9-5e6d-4c3e-b2c8-820f00848e4c tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:58.619068 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-b312f9d9-5e6d-4c3e-b2c8-820f00848e4c tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:58.619464 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-b312f9d9-5e6d-4c3e-b2c8-820f00848e4c tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:58.930555 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-b312f9d9-5e6d-4c3e-b2c8-820f00848e4c tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef8571ef39b4efe8f510a28052e2b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84bceeeb4f67456a90779360ffc620aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:33:58.941254 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-b312f9d9-5e6d-4c3e-b2c8-820f00848e4c tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] 10.222.0.87 "GET /compute/v2.1/servers/f69664c9-6a0c-4807-a429-f39a1823f6ac" status: 200 len: 1266 microversion: 2.1 time: 0.335435 Oct 29 01:33:58.951999 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 396/782] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:33:58 2021] GET /compute/v2.1/servers/f69664c9-6a0c-4807-a429-f39a1823f6ac => generated 1266 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:33:59.599598 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-54ccfaf0-617f-4e4d-95b0-636d2df37ed3 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-506543852", "imageRef": "3b1d5dc6-2b04-4433-9a93-1db6a740092b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "83a007f6-bd8f-4f0b-a900-af58d53d6b5a"}], "security_groups": [{"name": "tempest-securitygroup--2098845055"}], "key_name": "tempest-keypair-876787345", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:33:59.697775 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.network.neutron [None req-54ccfaf0-617f-4e4d-95b0-636d2df37ed3 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] validate_networks() for [('83a007f6-bd8f-4f0b-a900-af58d53d6b5a', None, None, None, None, None)] {{(pid=116379) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 29 01:33:59.960897 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-bfb41160-ce23-4de6-8479-f8b542179f5c tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:33:59.963290 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-bfb41160-ce23-4de6-8479-f8b542179f5c tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] [instance: f69664c9-6a0c-4807-a429-f39a1823f6ac] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:33:59.973870 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-bfb41160-ce23-4de6-8479-f8b542179f5c tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:59.975173 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-bfb41160-ce23-4de6-8479-f8b542179f5c tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:33:59.976172 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-bfb41160-ce23-4de6-8479-f8b542179f5c tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:33:59.977339 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-bfb41160-ce23-4de6-8479-f8b542179f5c tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:00.166762 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.virt.hardware [None req-54ccfaf0-617f-4e4d-95b0-636d2df37ed3 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Flavor limits 0:0:0 {{(pid=116379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:34:00.168396 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.virt.hardware [None req-54ccfaf0-617f-4e4d-95b0-636d2df37ed3 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Image limits 0:0:0 {{(pid=116379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:34:00.169218 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.virt.hardware [None req-54ccfaf0-617f-4e4d-95b0-636d2df37ed3 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Flavor pref 0:0:0 {{(pid=116379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:34:00.169710 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.virt.hardware [None req-54ccfaf0-617f-4e4d-95b0-636d2df37ed3 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Image pref 0:0:0 {{(pid=116379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:34:00.170354 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.virt.hardware [None req-54ccfaf0-617f-4e4d-95b0-636d2df37ed3 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:34:00.182919 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-54ccfaf0-617f-4e4d-95b0-636d2df37ed3 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:00.183519 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-54ccfaf0-617f-4e4d-95b0-636d2df37ed3 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:00.184359 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-54ccfaf0-617f-4e4d-95b0-636d2df37ed3 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:00.184792 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-54ccfaf0-617f-4e4d-95b0-636d2df37ed3 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:00.192877 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-bfb41160-ce23-4de6-8479-f8b542179f5c tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef8571ef39b4efe8f510a28052e2b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84bceeeb4f67456a90779360ffc620aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:00.203399 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-bfb41160-ce23-4de6-8479-f8b542179f5c tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] 10.222.0.87 "GET /compute/v2.1/servers/f69664c9-6a0c-4807-a429-f39a1823f6ac" status: 200 len: 1266 microversion: 2.1 time: 0.246297 Oct 29 01:34:00.204183 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 397/783] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:33:59 2021] GET /compute/v2.1/servers/f69664c9-6a0c-4807-a429-f39a1823f6ac => generated 1266 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:34:00.210469 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.quota [None req-54ccfaf0-617f-4e4d-95b0-636d2df37ed3 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Getting quotas for project 413ce1a7d8504d0b9f656d9e623f9005. Resources: {'instances', 'cores', 'ram'} {{(pid=116379) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 01:34:00.214544 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.quota [None req-54ccfaf0-617f-4e4d-95b0-636d2df37ed3 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Getting quotas for user 78823bdcff4e45d8ab82558b434f188d and project 413ce1a7d8504d0b9f656d9e623f9005. Resources: {'instances', 'cores', 'ram'} {{(pid=116379) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 01:34:00.228137 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-54ccfaf0-617f-4e4d-95b0-636d2df37ed3 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Going to run 1 instances... {{(pid=116379) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 29 01:34:00.229867 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-fa1d1588-6c79-412e-ac9e-eebd2d68d633 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1880155568", "imageRef": "3b1d5dc6-2b04-4433-9a93-1db6a740092b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "598c8fe0-c1fa-4706-88a3-f2e6ce25e99c"}], "security_groups": [{"name": "tempest-securitygroup--79527902"}], "key_name": "tempest-keypair-522909088", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:34:00.230569 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-54ccfaf0-617f-4e4d-95b0-636d2df37ed3 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3b1d5dc6-2b04-4433-9a93-1db6a740092b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116379) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 29 01:34:00.328901 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.network.neutron [None req-fa1d1588-6c79-412e-ac9e-eebd2d68d633 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] validate_networks() for [('598c8fe0-c1fa-4706-88a3-f2e6ce25e99c', None, None, None, None, None)] {{(pid=116378) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 29 01:34:00.410438 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-54ccfaf0-617f-4e4d-95b0-636d2df37ed3 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.814815 Oct 29 01:34:00.411460 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 387/784] 10.222.0.87 () {62 vars in 1187 bytes} [Fri Oct 29 01:33:59 2021] POST /compute/v2.1/servers => generated 402 bytes in 816 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 29 01:34:00.424968 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-b54f6890-9f4f-4c87-acca-82bc0191fcd4 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:00.425567 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-b54f6890-9f4f-4c87-acca-82bc0191fcd4 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:00.492194 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-b54f6890-9f4f-4c87-acca-82bc0191fcd4 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:00.501758 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-b54f6890-9f4f-4c87-acca-82bc0191fcd4 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:00.503235 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-b54f6890-9f4f-4c87-acca-82bc0191fcd4 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:00.504350 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-b54f6890-9f4f-4c87-acca-82bc0191fcd4 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a" status: 200 len: 1280 microversion: 2.20 time: 0.086663 Oct 29 01:34:00.515369 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 388/785] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:34:00 2021] GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a => generated 1280 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:34:00.743246 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.virt.hardware [None req-fa1d1588-6c79-412e-ac9e-eebd2d68d633 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Flavor limits 0:0:0 {{(pid=116378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:34:00.743659 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.virt.hardware [None req-fa1d1588-6c79-412e-ac9e-eebd2d68d633 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Image limits 0:0:0 {{(pid=116378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:34:00.744149 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.virt.hardware [None req-fa1d1588-6c79-412e-ac9e-eebd2d68d633 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Flavor pref 0:0:0 {{(pid=116378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:34:00.744977 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.virt.hardware [None req-fa1d1588-6c79-412e-ac9e-eebd2d68d633 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Image pref 0:0:0 {{(pid=116378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:34:00.745405 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.virt.hardware [None req-fa1d1588-6c79-412e-ac9e-eebd2d68d633 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:34:00.755305 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-fa1d1588-6c79-412e-ac9e-eebd2d68d633 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:00.755745 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-fa1d1588-6c79-412e-ac9e-eebd2d68d633 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:00.756561 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-fa1d1588-6c79-412e-ac9e-eebd2d68d633 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:00.756989 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-fa1d1588-6c79-412e-ac9e-eebd2d68d633 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:00.777625 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.quota [None req-fa1d1588-6c79-412e-ac9e-eebd2d68d633 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Getting quotas for project c51a2093a0874d52a08f6e25489ba181. Resources: {'instances', 'cores', 'ram'} {{(pid=116378) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 01:34:00.779619 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.quota [None req-fa1d1588-6c79-412e-ac9e-eebd2d68d633 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Getting quotas for user 045dda1ff9b44334954c08e63fcd20c0 and project c51a2093a0874d52a08f6e25489ba181. Resources: {'instances', 'cores', 'ram'} {{(pid=116378) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 01:34:00.798385 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-fa1d1588-6c79-412e-ac9e-eebd2d68d633 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Going to run 1 instances... {{(pid=116378) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 29 01:34:00.800763 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-fa1d1588-6c79-412e-ac9e-eebd2d68d633 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: ba08d2b5-ae9e-43db-b376-18011c8863f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3b1d5dc6-2b04-4433-9a93-1db6a740092b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116378) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 29 01:34:00.967632 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-fa1d1588-6c79-412e-ac9e-eebd2d68d633 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.739824 Oct 29 01:34:00.971158 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 398/786] 10.222.0.87 () {60 vars in 1146 bytes} [Fri Oct 29 01:34:00 2021] POST /compute/v2.1/servers => generated 400 bytes in 746 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 29 01:34:00.976222 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-d9be1a7c-9fed-456f-bc1a-239b11fb2969 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:00.976638 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-d9be1a7c-9fed-456f-bc1a-239b11fb2969 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: ba08d2b5-ae9e-43db-b376-18011c8863f6] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:01.063907 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-d9be1a7c-9fed-456f-bc1a-239b11fb2969 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045dda1ff9b44334954c08e63fcd20c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51a2093a0874d52a08f6e25489ba181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:01.071468 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-d9be1a7c-9fed-456f-bc1a-239b11fb2969 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6" status: 200 len: 1237 microversion: 2.1 time: 0.098702 Oct 29 01:34:01.071870 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 389/787] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:34:00 2021] GET /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6 => generated 1237 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:34:01.221683 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-dc7d61ff-29b4-4041-9c05-4fc6562d37af tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:01.222285 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-dc7d61ff-29b4-4041-9c05-4fc6562d37af tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] [instance: f69664c9-6a0c-4807-a429-f39a1823f6ac] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:01.229579 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-dc7d61ff-29b4-4041-9c05-4fc6562d37af tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:01.233380 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-dc7d61ff-29b4-4041-9c05-4fc6562d37af tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:01.233380 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-dc7d61ff-29b4-4041-9c05-4fc6562d37af tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:01.233380 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-dc7d61ff-29b4-4041-9c05-4fc6562d37af tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:01.513335 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-dc7d61ff-29b4-4041-9c05-4fc6562d37af tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef8571ef39b4efe8f510a28052e2b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84bceeeb4f67456a90779360ffc620aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:01.521609 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-dc7d61ff-29b4-4041-9c05-4fc6562d37af tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] 10.222.0.87 "GET /compute/v2.1/servers/f69664c9-6a0c-4807-a429-f39a1823f6ac" status: 200 len: 1266 microversion: 2.1 time: 0.305164 Oct 29 01:34:01.522212 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 399/788] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:34:01 2021] GET /compute/v2.1/servers/f69664c9-6a0c-4807-a429-f39a1823f6ac => generated 1266 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:34:01.522367 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-bb2a8f3c-3df3-4c39-bc36-2b9df5fd8773 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:01.522936 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-bb2a8f3c-3df3-4c39-bc36-2b9df5fd8773 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:01.528765 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-bb2a8f3c-3df3-4c39-bc36-2b9df5fd8773 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:01.529207 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-bb2a8f3c-3df3-4c39-bc36-2b9df5fd8773 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:01.529963 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-bb2a8f3c-3df3-4c39-bc36-2b9df5fd8773 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:01.531066 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-bb2a8f3c-3df3-4c39-bc36-2b9df5fd8773 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:01.598007 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-bb2a8f3c-3df3-4c39-bc36-2b9df5fd8773 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:01.607890 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-bb2a8f3c-3df3-4c39-bc36-2b9df5fd8773 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:01.610040 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-bb2a8f3c-3df3-4c39-bc36-2b9df5fd8773 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:01.611480 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-bb2a8f3c-3df3-4c39-bc36-2b9df5fd8773 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a" status: 200 len: 1284 microversion: 2.20 time: 0.092661 Oct 29 01:34:01.612116 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 390/789] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:34:01 2021] GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a => generated 1284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:34:02.087742 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-be7d8537-5b4d-4b5d-b494-aad51e2cea0e tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:02.088346 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-be7d8537-5b4d-4b5d-b494-aad51e2cea0e tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: ba08d2b5-ae9e-43db-b376-18011c8863f6] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:02.138850 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-be7d8537-5b4d-4b5d-b494-aad51e2cea0e tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045dda1ff9b44334954c08e63fcd20c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51a2093a0874d52a08f6e25489ba181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:02.146203 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-be7d8537-5b4d-4b5d-b494-aad51e2cea0e tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6" status: 200 len: 1237 microversion: 2.1 time: 0.062217 Oct 29 01:34:02.146824 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 400/790] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:34:02 2021] GET /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6 => generated 1237 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:34:02.538363 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-271a93db-4004-4375-a7b8-797c86eb3d69 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:02.538966 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-271a93db-4004-4375-a7b8-797c86eb3d69 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] [instance: f69664c9-6a0c-4807-a429-f39a1823f6ac] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:02.545472 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-271a93db-4004-4375-a7b8-797c86eb3d69 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:02.546496 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-271a93db-4004-4375-a7b8-797c86eb3d69 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:02.547298 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-271a93db-4004-4375-a7b8-797c86eb3d69 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:02.547892 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-271a93db-4004-4375-a7b8-797c86eb3d69 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:02.629602 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-fd769f3f-7d5e-49a2-84c9-f4aea9efda51 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:02.630236 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-fd769f3f-7d5e-49a2-84c9-f4aea9efda51 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:02.636816 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-fd769f3f-7d5e-49a2-84c9-f4aea9efda51 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:02.637259 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-fd769f3f-7d5e-49a2-84c9-f4aea9efda51 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:02.638072 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-fd769f3f-7d5e-49a2-84c9-f4aea9efda51 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:02.639031 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-fd769f3f-7d5e-49a2-84c9-f4aea9efda51 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:02.678543 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-271a93db-4004-4375-a7b8-797c86eb3d69 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef8571ef39b4efe8f510a28052e2b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84bceeeb4f67456a90779360ffc620aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:02.690822 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-271a93db-4004-4375-a7b8-797c86eb3d69 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] 10.222.0.87 "GET /compute/v2.1/servers/f69664c9-6a0c-4807-a429-f39a1823f6ac" status: 200 len: 1266 microversion: 2.1 time: 0.151999 Oct 29 01:34:02.690822 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 391/791] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:34:02 2021] GET /compute/v2.1/servers/f69664c9-6a0c-4807-a429-f39a1823f6ac => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:34:02.707315 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-fd769f3f-7d5e-49a2-84c9-f4aea9efda51 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:02.715192 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-fd769f3f-7d5e-49a2-84c9-f4aea9efda51 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:02.717570 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-fd769f3f-7d5e-49a2-84c9-f4aea9efda51 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:02.718614 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-fd769f3f-7d5e-49a2-84c9-f4aea9efda51 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a" status: 200 len: 1332 microversion: 2.20 time: 0.092126 Oct 29 01:34:02.719270 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 401/792] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:34:02 2021] GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a => generated 1332 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:34:03.162714 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-6bf2b7ac-de26-4b2d-ab2c-1ca12dc9502d tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:03.163440 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-6bf2b7ac-de26-4b2d-ab2c-1ca12dc9502d tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: ba08d2b5-ae9e-43db-b376-18011c8863f6] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:03.169216 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-6bf2b7ac-de26-4b2d-ab2c-1ca12dc9502d tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:03.169664 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-6bf2b7ac-de26-4b2d-ab2c-1ca12dc9502d tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:03.170444 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-6bf2b7ac-de26-4b2d-ab2c-1ca12dc9502d tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:03.170874 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-6bf2b7ac-de26-4b2d-ab2c-1ca12dc9502d tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:03.230129 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-6bf2b7ac-de26-4b2d-ab2c-1ca12dc9502d tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045dda1ff9b44334954c08e63fcd20c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51a2093a0874d52a08f6e25489ba181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:03.237847 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-6bf2b7ac-de26-4b2d-ab2c-1ca12dc9502d tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6" status: 200 len: 1289 microversion: 2.1 time: 0.078906 Oct 29 01:34:03.238687 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 392/793] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:34:03 2021] GET /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6 => generated 1289 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:34:03.705352 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-a2644f3f-f25c-403f-a704-5fff675b4270 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:03.705897 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-a2644f3f-f25c-403f-a704-5fff675b4270 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] [instance: f69664c9-6a0c-4807-a429-f39a1823f6ac] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:03.712250 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a2644f3f-f25c-403f-a704-5fff675b4270 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:03.712974 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a2644f3f-f25c-403f-a704-5fff675b4270 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:03.714024 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a2644f3f-f25c-403f-a704-5fff675b4270 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:03.714626 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a2644f3f-f25c-403f-a704-5fff675b4270 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:03.736326 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-96528f0f-57c0-4810-9d0b-288cdf65c527 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:03.737078 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-96528f0f-57c0-4810-9d0b-288cdf65c527 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:03.744757 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-96528f0f-57c0-4810-9d0b-288cdf65c527 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:03.745209 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-96528f0f-57c0-4810-9d0b-288cdf65c527 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:03.746116 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-96528f0f-57c0-4810-9d0b-288cdf65c527 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:03.746569 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-96528f0f-57c0-4810-9d0b-288cdf65c527 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:03.936562 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-a2644f3f-f25c-403f-a704-5fff675b4270 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef8571ef39b4efe8f510a28052e2b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84bceeeb4f67456a90779360ffc620aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:03.946543 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-a2644f3f-f25c-403f-a704-5fff675b4270 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] 10.222.0.87 "GET /compute/v2.1/servers/f69664c9-6a0c-4807-a429-f39a1823f6ac" status: 200 len: 1266 microversion: 2.1 time: 0.245871 Oct 29 01:34:03.947920 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 402/794] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:34:03 2021] GET /compute/v2.1/servers/f69664c9-6a0c-4807-a429-f39a1823f6ac => generated 1266 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:34:04.065008 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-96528f0f-57c0-4810-9d0b-288cdf65c527 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:04.073804 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-96528f0f-57c0-4810-9d0b-288cdf65c527 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:04.076525 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-96528f0f-57c0-4810-9d0b-288cdf65c527 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:04.078892 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-96528f0f-57c0-4810-9d0b-288cdf65c527 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a" status: 200 len: 1406 microversion: 2.20 time: 0.346245 Oct 29 01:34:04.079752 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 393/795] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:34:03 2021] GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a => generated 1406 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:34:04.256041 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-429508e2-6f28-46a8-9677-686dc69a8171 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:04.257045 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-429508e2-6f28-46a8-9677-686dc69a8171 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: ba08d2b5-ae9e-43db-b376-18011c8863f6] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:04.264401 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-429508e2-6f28-46a8-9677-686dc69a8171 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:04.264401 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-429508e2-6f28-46a8-9677-686dc69a8171 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:04.266884 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-429508e2-6f28-46a8-9677-686dc69a8171 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:04.266884 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-429508e2-6f28-46a8-9677-686dc69a8171 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:04.359556 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-429508e2-6f28-46a8-9677-686dc69a8171 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045dda1ff9b44334954c08e63fcd20c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51a2093a0874d52a08f6e25489ba181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:04.383147 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-429508e2-6f28-46a8-9677-686dc69a8171 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6" status: 200 len: 1295 microversion: 2.1 time: 0.131352 Oct 29 01:34:04.394037 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 403/796] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:34:04 2021] GET /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6 => generated 1295 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:34:04.943187 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [req-98e38ac0-2ce0-4813-9f16-3e60db542537 req-f9fdc042-8eac-4417-a07b-309edc08753d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91b62925-d26a-4afb-bab2-c0288f74404a", "tag": "aee32650-07ba-4e45-a318-0849274af2bf"}]} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:34:04.945434 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:34:04.945434 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: warnings.warn(msg) Oct 29 01:34:04.961862 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [req-98e38ac0-2ce0-4813-9f16-3e60db542537 req-f9fdc042-8eac-4417-a07b-309edc08753d service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:04.962340 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [req-98e38ac0-2ce0-4813-9f16-3e60db542537 req-f9fdc042-8eac-4417-a07b-309edc08753d service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:04.964530 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-31925bfc-9a3b-4054-81a4-f070fe077d01 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:04.965306 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-31925bfc-9a3b-4054-81a4-f070fe077d01 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] [instance: f69664c9-6a0c-4807-a429-f39a1823f6ac] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:04.978526 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-31925bfc-9a3b-4054-81a4-f070fe077d01 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:04.978990 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-31925bfc-9a3b-4054-81a4-f070fe077d01 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:04.979773 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.compute.server_external_events [req-98e38ac0-2ce0-4813-9f16-3e60db542537 req-f9fdc042-8eac-4417-a07b-309edc08753d service nova] Creating event network-changed:aee32650-07ba-4e45-a318-0849274af2bf for instance 91b62925-d26a-4afb-bab2-c0288f74404a on hv-cinder-81398 Oct 29 01:34:04.987889 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-31925bfc-9a3b-4054-81a4-f070fe077d01 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:04.987889 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-31925bfc-9a3b-4054-81a4-f070fe077d01 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:04.988168 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [req-98e38ac0-2ce0-4813-9f16-3e60db542537 req-f9fdc042-8eac-4417-a07b-309edc08753d service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058430 Oct 29 01:34:04.989542 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 394/797] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Oct 29 01:34:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:34:05.100491 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-98262e07-d3a0-4a6f-9d0e-1a5a01a31a46 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:05.101273 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-98262e07-d3a0-4a6f-9d0e-1a5a01a31a46 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:05.122873 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-98262e07-d3a0-4a6f-9d0e-1a5a01a31a46 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:05.123577 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-98262e07-d3a0-4a6f-9d0e-1a5a01a31a46 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:05.130170 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-98262e07-d3a0-4a6f-9d0e-1a5a01a31a46 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:05.130170 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-98262e07-d3a0-4a6f-9d0e-1a5a01a31a46 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:05.291919 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-31925bfc-9a3b-4054-81a4-f070fe077d01 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef8571ef39b4efe8f510a28052e2b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84bceeeb4f67456a90779360ffc620aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:05.300077 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-31925bfc-9a3b-4054-81a4-f070fe077d01 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] 10.222.0.87 "GET /compute/v2.1/servers/f69664c9-6a0c-4807-a429-f39a1823f6ac" status: 200 len: 1266 microversion: 2.1 time: 0.339285 Oct 29 01:34:05.300651 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 404/798] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:34:04 2021] GET /compute/v2.1/servers/f69664c9-6a0c-4807-a429-f39a1823f6ac => generated 1266 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:34:05.404633 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-4ffe16dc-4b56-45f4-b6b2-e89facf11c47 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:05.405478 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-4ffe16dc-4b56-45f4-b6b2-e89facf11c47 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: ba08d2b5-ae9e-43db-b376-18011c8863f6] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:05.413486 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4ffe16dc-4b56-45f4-b6b2-e89facf11c47 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:05.417132 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4ffe16dc-4b56-45f4-b6b2-e89facf11c47 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:05.417132 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4ffe16dc-4b56-45f4-b6b2-e89facf11c47 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:05.417132 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4ffe16dc-4b56-45f4-b6b2-e89facf11c47 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:05.697107 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-98262e07-d3a0-4a6f-9d0e-1a5a01a31a46 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:05.706180 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-98262e07-d3a0-4a6f-9d0e-1a5a01a31a46 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:05.707855 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-98262e07-d3a0-4a6f-9d0e-1a5a01a31a46 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:05.709053 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-98262e07-d3a0-4a6f-9d0e-1a5a01a31a46 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a" status: 200 len: 1406 microversion: 2.20 time: 0.615348 Oct 29 01:34:05.709696 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 395/799] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:34:05 2021] GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a => generated 1406 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:34:05.754777 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-4ffe16dc-4b56-45f4-b6b2-e89facf11c47 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045dda1ff9b44334954c08e63fcd20c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51a2093a0874d52a08f6e25489ba181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:05.762441 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-4ffe16dc-4b56-45f4-b6b2-e89facf11c47 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6" status: 200 len: 1361 microversion: 2.1 time: 0.364032 Oct 29 01:34:05.763027 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 405/800] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:34:05 2021] GET /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6 => generated 1361 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:34:06.107892 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [req-5dbfb2e8-8e47-4439-b4b3-fd13403d692b req-c323e289-8632-4a7c-b622-17c59027c393 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba08d2b5-ae9e-43db-b376-18011c8863f6", "tag": "334d5ed1-db63-42dc-bee7-9a695829f7de"}]} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:34:06.110727 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:34:06.110727 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: warnings.warn(msg) Oct 29 01:34:06.118384 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [req-5dbfb2e8-8e47-4439-b4b3-fd13403d692b req-c323e289-8632-4a7c-b622-17c59027c393 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:06.118791 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [req-5dbfb2e8-8e47-4439-b4b3-fd13403d692b req-c323e289-8632-4a7c-b622-17c59027c393 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:06.133509 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.compute.server_external_events [req-5dbfb2e8-8e47-4439-b4b3-fd13403d692b req-c323e289-8632-4a7c-b622-17c59027c393 service nova] Creating event network-changed:334d5ed1-db63-42dc-bee7-9a695829f7de for instance ba08d2b5-ae9e-43db-b376-18011c8863f6 on hv-cinder-81398 Oct 29 01:34:06.139456 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [req-5dbfb2e8-8e47-4439-b4b3-fd13403d692b req-c323e289-8632-4a7c-b622-17c59027c393 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035234 Oct 29 01:34:06.140631 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 396/801] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Oct 29 01:34:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:34:06.317796 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-2cb2e348-af7a-43a6-b865-0818fad0b161 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:06.318393 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-2cb2e348-af7a-43a6-b865-0818fad0b161 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] [instance: f69664c9-6a0c-4807-a429-f39a1823f6ac] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:06.324552 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-2cb2e348-af7a-43a6-b865-0818fad0b161 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:06.324986 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-2cb2e348-af7a-43a6-b865-0818fad0b161 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:06.325740 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-2cb2e348-af7a-43a6-b865-0818fad0b161 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:06.326180 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-2cb2e348-af7a-43a6-b865-0818fad0b161 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:06.450113 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-2cb2e348-af7a-43a6-b865-0818fad0b161 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef8571ef39b4efe8f510a28052e2b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84bceeeb4f67456a90779360ffc620aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:06.457958 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-2cb2e348-af7a-43a6-b865-0818fad0b161 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] 10.222.0.87 "GET /compute/v2.1/servers/f69664c9-6a0c-4807-a429-f39a1823f6ac" status: 200 len: 1266 microversion: 2.1 time: 0.143812 Oct 29 01:34:06.458524 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 406/802] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:34:06 2021] GET /compute/v2.1/servers/f69664c9-6a0c-4807-a429-f39a1823f6ac => generated 1266 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:34:06.727840 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-009b261e-e1af-4510-9f7f-8c2e95d6b894 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:06.728518 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-009b261e-e1af-4510-9f7f-8c2e95d6b894 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:06.734705 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-009b261e-e1af-4510-9f7f-8c2e95d6b894 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:06.735142 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-009b261e-e1af-4510-9f7f-8c2e95d6b894 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:06.735930 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-009b261e-e1af-4510-9f7f-8c2e95d6b894 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:06.736353 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-009b261e-e1af-4510-9f7f-8c2e95d6b894 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:06.779891 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-5f0622dd-03c5-4396-b87c-21cb04621521 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:06.781137 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-5f0622dd-03c5-4396-b87c-21cb04621521 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: ba08d2b5-ae9e-43db-b376-18011c8863f6] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:06.788638 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-5f0622dd-03c5-4396-b87c-21cb04621521 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:06.789091 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-5f0622dd-03c5-4396-b87c-21cb04621521 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:06.789885 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-5f0622dd-03c5-4396-b87c-21cb04621521 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:06.790315 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-5f0622dd-03c5-4396-b87c-21cb04621521 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:06.885797 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-009b261e-e1af-4510-9f7f-8c2e95d6b894 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:06.894630 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-009b261e-e1af-4510-9f7f-8c2e95d6b894 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:06.896117 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-009b261e-e1af-4510-9f7f-8c2e95d6b894 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:06.897216 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-009b261e-e1af-4510-9f7f-8c2e95d6b894 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a" status: 200 len: 1406 microversion: 2.20 time: 0.173490 Oct 29 01:34:06.908208 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 397/803] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:34:06 2021] GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a => generated 1406 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:34:06.937297 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-5f0622dd-03c5-4396-b87c-21cb04621521 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045dda1ff9b44334954c08e63fcd20c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51a2093a0874d52a08f6e25489ba181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:06.944552 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-5f0622dd-03c5-4396-b87c-21cb04621521 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6" status: 200 len: 1361 microversion: 2.1 time: 0.168220 Oct 29 01:34:06.945119 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 407/804] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:34:06 2021] GET /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6 => generated 1361 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:34:07.475207 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-c1161f35-c09c-4872-95cb-c7f8a8ecd1ee tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:07.475778 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-c1161f35-c09c-4872-95cb-c7f8a8ecd1ee tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] [instance: f69664c9-6a0c-4807-a429-f39a1823f6ac] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:07.481942 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-c1161f35-c09c-4872-95cb-c7f8a8ecd1ee tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:07.484085 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-c1161f35-c09c-4872-95cb-c7f8a8ecd1ee tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:07.484085 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-c1161f35-c09c-4872-95cb-c7f8a8ecd1ee tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:07.484085 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-c1161f35-c09c-4872-95cb-c7f8a8ecd1ee tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:07.604683 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-c1161f35-c09c-4872-95cb-c7f8a8ecd1ee tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef8571ef39b4efe8f510a28052e2b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84bceeeb4f67456a90779360ffc620aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:07.612439 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-c1161f35-c09c-4872-95cb-c7f8a8ecd1ee tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] 10.222.0.87 "GET /compute/v2.1/servers/f69664c9-6a0c-4807-a429-f39a1823f6ac" status: 200 len: 1266 microversion: 2.1 time: 0.141036 Oct 29 01:34:07.613013 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 398/805] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:34:07 2021] GET /compute/v2.1/servers/f69664c9-6a0c-4807-a429-f39a1823f6ac => generated 1266 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:34:07.915568 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-1df84798-9c4f-448b-a4ce-29fa66053cd9 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:07.916222 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-1df84798-9c4f-448b-a4ce-29fa66053cd9 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:07.923022 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-1df84798-9c4f-448b-a4ce-29fa66053cd9 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:07.923429 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-1df84798-9c4f-448b-a4ce-29fa66053cd9 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:07.924254 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-1df84798-9c4f-448b-a4ce-29fa66053cd9 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:07.924688 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-1df84798-9c4f-448b-a4ce-29fa66053cd9 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:07.962041 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-9d5bf426-c4ba-4fb6-ba3f-d6151c12d59f tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:07.962638 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-9d5bf426-c4ba-4fb6-ba3f-d6151c12d59f tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: ba08d2b5-ae9e-43db-b376-18011c8863f6] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:07.969167 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-9d5bf426-c4ba-4fb6-ba3f-d6151c12d59f tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:07.969637 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-9d5bf426-c4ba-4fb6-ba3f-d6151c12d59f tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:07.970414 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-9d5bf426-c4ba-4fb6-ba3f-d6151c12d59f tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:07.970860 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-9d5bf426-c4ba-4fb6-ba3f-d6151c12d59f tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:08.072820 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-1df84798-9c4f-448b-a4ce-29fa66053cd9 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:08.081280 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-1df84798-9c4f-448b-a4ce-29fa66053cd9 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:08.082773 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-1df84798-9c4f-448b-a4ce-29fa66053cd9 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:08.084003 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-1df84798-9c4f-448b-a4ce-29fa66053cd9 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a" status: 200 len: 1406 microversion: 2.20 time: 0.171998 Oct 29 01:34:08.084518 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 408/806] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:34:07 2021] GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a => generated 1406 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:34:08.143803 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-9d5bf426-c4ba-4fb6-ba3f-d6151c12d59f tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045dda1ff9b44334954c08e63fcd20c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51a2093a0874d52a08f6e25489ba181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:08.152369 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-9d5bf426-c4ba-4fb6-ba3f-d6151c12d59f tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6" status: 200 len: 1361 microversion: 2.1 time: 0.193693 Oct 29 01:34:08.157567 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 399/807] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:34:07 2021] GET /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6 => generated 1361 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:34:08.631808 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-6a62d640-c713-4dcf-8bf5-ae247b245608 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:08.632715 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-6a62d640-c713-4dcf-8bf5-ae247b245608 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] [instance: f69664c9-6a0c-4807-a429-f39a1823f6ac] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:08.648636 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-6a62d640-c713-4dcf-8bf5-ae247b245608 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:08.649604 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-6a62d640-c713-4dcf-8bf5-ae247b245608 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:08.651240 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-6a62d640-c713-4dcf-8bf5-ae247b245608 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:08.651879 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-6a62d640-c713-4dcf-8bf5-ae247b245608 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:08.869850 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-6a62d640-c713-4dcf-8bf5-ae247b245608 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef8571ef39b4efe8f510a28052e2b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84bceeeb4f67456a90779360ffc620aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:08.880804 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-6a62d640-c713-4dcf-8bf5-ae247b245608 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] 10.222.0.87 "GET /compute/v2.1/servers/f69664c9-6a0c-4807-a429-f39a1823f6ac" status: 200 len: 1266 microversion: 2.1 time: 0.253317 Oct 29 01:34:08.881422 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 409/808] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:34:08 2021] GET /compute/v2.1/servers/f69664c9-6a0c-4807-a429-f39a1823f6ac => generated 1266 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:34:09.105117 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-f7b00a0f-47cc-4901-9890-1941b02d3e94 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:09.106443 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-f7b00a0f-47cc-4901-9890-1941b02d3e94 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:09.113342 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-f7b00a0f-47cc-4901-9890-1941b02d3e94 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:09.113794 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-f7b00a0f-47cc-4901-9890-1941b02d3e94 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:09.114568 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-f7b00a0f-47cc-4901-9890-1941b02d3e94 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:09.114999 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-f7b00a0f-47cc-4901-9890-1941b02d3e94 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:09.170209 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-c44257d4-3013-4d0d-8e99-e834036ba482 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:09.171411 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-c44257d4-3013-4d0d-8e99-e834036ba482 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: ba08d2b5-ae9e-43db-b376-18011c8863f6] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:09.178070 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c44257d4-3013-4d0d-8e99-e834036ba482 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:09.178510 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c44257d4-3013-4d0d-8e99-e834036ba482 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:09.179306 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c44257d4-3013-4d0d-8e99-e834036ba482 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:09.179831 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c44257d4-3013-4d0d-8e99-e834036ba482 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:09.285120 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-f7b00a0f-47cc-4901-9890-1941b02d3e94 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:09.294374 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-f7b00a0f-47cc-4901-9890-1941b02d3e94 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:09.309275 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-f7b00a0f-47cc-4901-9890-1941b02d3e94 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:09.309275 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-f7b00a0f-47cc-4901-9890-1941b02d3e94 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a" status: 200 len: 1406 microversion: 2.20 time: 0.196986 Oct 29 01:34:09.309275 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 400/809] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:34:09 2021] GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a => generated 1406 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:34:09.342272 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-c44257d4-3013-4d0d-8e99-e834036ba482 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045dda1ff9b44334954c08e63fcd20c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51a2093a0874d52a08f6e25489ba181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:09.351621 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-c44257d4-3013-4d0d-8e99-e834036ba482 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6" status: 200 len: 1361 microversion: 2.1 time: 0.185052 Oct 29 01:34:09.352562 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 410/810] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:34:09 2021] GET /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6 => generated 1361 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:34:09.897737 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-2d2a99a0-9cb2-4ee4-b220-5fa10aef8de6 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:09.898363 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-2d2a99a0-9cb2-4ee4-b220-5fa10aef8de6 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] [instance: f69664c9-6a0c-4807-a429-f39a1823f6ac] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:09.904516 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-2d2a99a0-9cb2-4ee4-b220-5fa10aef8de6 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:09.904960 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-2d2a99a0-9cb2-4ee4-b220-5fa10aef8de6 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:09.906525 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-2d2a99a0-9cb2-4ee4-b220-5fa10aef8de6 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:09.906992 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-2d2a99a0-9cb2-4ee4-b220-5fa10aef8de6 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:10.029361 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-2d2a99a0-9cb2-4ee4-b220-5fa10aef8de6 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef8571ef39b4efe8f510a28052e2b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84bceeeb4f67456a90779360ffc620aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:10.037481 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-2d2a99a0-9cb2-4ee4-b220-5fa10aef8de6 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] 10.222.0.87 "GET /compute/v2.1/servers/f69664c9-6a0c-4807-a429-f39a1823f6ac" status: 200 len: 1266 microversion: 2.1 time: 0.143396 Oct 29 01:34:10.038050 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 401/811] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:34:09 2021] GET /compute/v2.1/servers/f69664c9-6a0c-4807-a429-f39a1823f6ac => generated 1266 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:34:10.317237 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-98c61dc3-56a8-4f35-b3e5-0d3ab7d8c748 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:10.317817 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-98c61dc3-56a8-4f35-b3e5-0d3ab7d8c748 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:10.324070 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-98c61dc3-56a8-4f35-b3e5-0d3ab7d8c748 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:10.329360 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-98c61dc3-56a8-4f35-b3e5-0d3ab7d8c748 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:10.329360 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-98c61dc3-56a8-4f35-b3e5-0d3ab7d8c748 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:10.329360 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-98c61dc3-56a8-4f35-b3e5-0d3ab7d8c748 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:10.369235 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-e78ea326-95f8-4a15-b134-2d6c78ab7eb4 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:10.369922 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-e78ea326-95f8-4a15-b134-2d6c78ab7eb4 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: ba08d2b5-ae9e-43db-b376-18011c8863f6] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:10.377796 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-e78ea326-95f8-4a15-b134-2d6c78ab7eb4 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:10.378393 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-e78ea326-95f8-4a15-b134-2d6c78ab7eb4 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:10.379165 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-e78ea326-95f8-4a15-b134-2d6c78ab7eb4 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:10.379587 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-e78ea326-95f8-4a15-b134-2d6c78ab7eb4 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:10.491431 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-98c61dc3-56a8-4f35-b3e5-0d3ab7d8c748 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:10.503574 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-98c61dc3-56a8-4f35-b3e5-0d3ab7d8c748 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:10.505290 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-98c61dc3-56a8-4f35-b3e5-0d3ab7d8c748 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:10.506415 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-98c61dc3-56a8-4f35-b3e5-0d3ab7d8c748 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a" status: 200 len: 1406 microversion: 2.20 time: 0.192933 Oct 29 01:34:10.512592 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 411/812] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:34:10 2021] GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a => generated 1406 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:34:10.554838 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-e78ea326-95f8-4a15-b134-2d6c78ab7eb4 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045dda1ff9b44334954c08e63fcd20c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51a2093a0874d52a08f6e25489ba181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:10.562575 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-e78ea326-95f8-4a15-b134-2d6c78ab7eb4 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6" status: 200 len: 1361 microversion: 2.1 time: 0.197193 Oct 29 01:34:10.563147 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 402/813] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:34:10 2021] GET /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6 => generated 1361 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:34:11.054368 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-003c94bd-0f6e-41f8-9206-8d5f5cf466c4 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:11.054959 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-003c94bd-0f6e-41f8-9206-8d5f5cf466c4 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] [instance: f69664c9-6a0c-4807-a429-f39a1823f6ac] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:11.060882 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-003c94bd-0f6e-41f8-9206-8d5f5cf466c4 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:11.061350 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-003c94bd-0f6e-41f8-9206-8d5f5cf466c4 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:11.062181 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-003c94bd-0f6e-41f8-9206-8d5f5cf466c4 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:11.062605 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-003c94bd-0f6e-41f8-9206-8d5f5cf466c4 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:11.185143 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-003c94bd-0f6e-41f8-9206-8d5f5cf466c4 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef8571ef39b4efe8f510a28052e2b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84bceeeb4f67456a90779360ffc620aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:11.192822 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-003c94bd-0f6e-41f8-9206-8d5f5cf466c4 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] 10.222.0.87 "GET /compute/v2.1/servers/f69664c9-6a0c-4807-a429-f39a1823f6ac" status: 200 len: 1266 microversion: 2.1 time: 0.142132 Oct 29 01:34:11.199979 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 412/814] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:34:11 2021] GET /compute/v2.1/servers/f69664c9-6a0c-4807-a429-f39a1823f6ac => generated 1266 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:34:11.467032 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [req-870c79e6-b65c-4e75-9300-d0beca15f47e req-b9016084-286a-4067-8a0f-578baad36634 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f69664c9-6a0c-4807-a429-f39a1823f6ac", "name": "network-vif-plugged", "status": "completed", "tag": "569ffd45-8958-4842-9d3e-75bdbaf74160"}]} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:34:11.468886 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:34:11.468886 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: warnings.warn(msg) Oct 29 01:34:11.476527 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [req-870c79e6-b65c-4e75-9300-d0beca15f47e req-b9016084-286a-4067-8a0f-578baad36634 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:11.476996 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [req-870c79e6-b65c-4e75-9300-d0beca15f47e req-b9016084-286a-4067-8a0f-578baad36634 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:11.488970 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.compute.server_external_events [req-870c79e6-b65c-4e75-9300-d0beca15f47e req-b9016084-286a-4067-8a0f-578baad36634 service nova] Creating event network-vif-plugged:569ffd45-8958-4842-9d3e-75bdbaf74160 for instance f69664c9-6a0c-4807-a429-f39a1823f6ac on hv-cinder-81398 Oct 29 01:34:11.493812 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [req-870c79e6-b65c-4e75-9300-d0beca15f47e req-b9016084-286a-4067-8a0f-578baad36634 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030472 Oct 29 01:34:11.494890 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 403/815] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Oct 29 01:34:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:34:11.525047 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-ef385e93-071f-414b-a9d1-df52a52411a2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:11.525644 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-ef385e93-071f-414b-a9d1-df52a52411a2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:11.532061 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ef385e93-071f-414b-a9d1-df52a52411a2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:11.532511 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ef385e93-071f-414b-a9d1-df52a52411a2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:11.533307 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ef385e93-071f-414b-a9d1-df52a52411a2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:11.533743 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ef385e93-071f-414b-a9d1-df52a52411a2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:11.579388 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-0a785c10-56bf-492b-ab61-6a21299c341f tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:11.580197 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-0a785c10-56bf-492b-ab61-6a21299c341f tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: ba08d2b5-ae9e-43db-b376-18011c8863f6] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:11.586256 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-0a785c10-56bf-492b-ab61-6a21299c341f tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:11.586781 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-0a785c10-56bf-492b-ab61-6a21299c341f tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:11.587649 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-0a785c10-56bf-492b-ab61-6a21299c341f tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:11.588198 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-0a785c10-56bf-492b-ab61-6a21299c341f tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:11.692189 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-ef385e93-071f-414b-a9d1-df52a52411a2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:11.699886 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-ef385e93-071f-414b-a9d1-df52a52411a2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:11.701362 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-ef385e93-071f-414b-a9d1-df52a52411a2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:11.702520 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-ef385e93-071f-414b-a9d1-df52a52411a2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a" status: 200 len: 1406 microversion: 2.20 time: 0.181197 Oct 29 01:34:11.703415 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 413/816] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:34:11 2021] GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a => generated 1406 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:34:11.742887 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-0a785c10-56bf-492b-ab61-6a21299c341f tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045dda1ff9b44334954c08e63fcd20c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51a2093a0874d52a08f6e25489ba181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:11.750188 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-0a785c10-56bf-492b-ab61-6a21299c341f tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6" status: 200 len: 1361 microversion: 2.1 time: 0.175317 Oct 29 01:34:11.750752 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 404/817] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:34:11 2021] GET /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6 => generated 1361 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:34:12.216702 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-77744a25-eb04-45de-9599-63a76e257ed6 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:12.217486 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-77744a25-eb04-45de-9599-63a76e257ed6 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] [instance: f69664c9-6a0c-4807-a429-f39a1823f6ac] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:12.223501 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-77744a25-eb04-45de-9599-63a76e257ed6 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:12.224073 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-77744a25-eb04-45de-9599-63a76e257ed6 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:12.224843 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-77744a25-eb04-45de-9599-63a76e257ed6 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:12.225269 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-77744a25-eb04-45de-9599-63a76e257ed6 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:12.347715 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-77744a25-eb04-45de-9599-63a76e257ed6 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef8571ef39b4efe8f510a28052e2b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84bceeeb4f67456a90779360ffc620aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:12.355378 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-77744a25-eb04-45de-9599-63a76e257ed6 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] 10.222.0.87 "GET /compute/v2.1/servers/f69664c9-6a0c-4807-a429-f39a1823f6ac" status: 200 len: 1266 microversion: 2.1 time: 0.142320 Oct 29 01:34:12.356012 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 414/818] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:34:12 2021] GET /compute/v2.1/servers/f69664c9-6a0c-4807-a429-f39a1823f6ac => generated 1266 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:34:12.720752 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-f823cdf5-490a-4129-a55b-704fcaa96c54 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:12.721336 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-f823cdf5-490a-4129-a55b-704fcaa96c54 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:12.729011 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-f823cdf5-490a-4129-a55b-704fcaa96c54 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:12.729462 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-f823cdf5-490a-4129-a55b-704fcaa96c54 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:12.730238 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-f823cdf5-490a-4129-a55b-704fcaa96c54 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:12.730694 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-f823cdf5-490a-4129-a55b-704fcaa96c54 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:12.766482 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-a91aff61-acaa-4a34-94eb-4e0557261f52 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:12.767325 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-a91aff61-acaa-4a34-94eb-4e0557261f52 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: ba08d2b5-ae9e-43db-b376-18011c8863f6] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:12.774266 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a91aff61-acaa-4a34-94eb-4e0557261f52 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:12.774713 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a91aff61-acaa-4a34-94eb-4e0557261f52 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:12.775491 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a91aff61-acaa-4a34-94eb-4e0557261f52 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:12.775965 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a91aff61-acaa-4a34-94eb-4e0557261f52 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:12.940300 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-f823cdf5-490a-4129-a55b-704fcaa96c54 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:12.948188 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-f823cdf5-490a-4129-a55b-704fcaa96c54 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:12.949694 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-f823cdf5-490a-4129-a55b-704fcaa96c54 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:12.950801 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-f823cdf5-490a-4129-a55b-704fcaa96c54 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a" status: 200 len: 1406 microversion: 2.20 time: 0.233862 Oct 29 01:34:12.951361 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 405/819] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:34:12 2021] GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a => generated 1406 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:34:12.968940 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-a91aff61-acaa-4a34-94eb-4e0557261f52 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045dda1ff9b44334954c08e63fcd20c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51a2093a0874d52a08f6e25489ba181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:12.976203 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-a91aff61-acaa-4a34-94eb-4e0557261f52 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6" status: 200 len: 1361 microversion: 2.1 time: 0.213590 Oct 29 01:34:12.981311 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 415/820] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:34:12 2021] GET /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6 => generated 1361 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:34:13.373550 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-683bb62b-6a98-4f3f-a68b-db676aac0b27 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:13.374161 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-683bb62b-6a98-4f3f-a68b-db676aac0b27 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] [instance: f69664c9-6a0c-4807-a429-f39a1823f6ac] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:13.380170 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-683bb62b-6a98-4f3f-a68b-db676aac0b27 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:13.382024 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-683bb62b-6a98-4f3f-a68b-db676aac0b27 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:13.382024 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-683bb62b-6a98-4f3f-a68b-db676aac0b27 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:13.382024 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-683bb62b-6a98-4f3f-a68b-db676aac0b27 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:13.589704 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-683bb62b-6a98-4f3f-a68b-db676aac0b27 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef8571ef39b4efe8f510a28052e2b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84bceeeb4f67456a90779360ffc620aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:13.606250 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-683bb62b-6a98-4f3f-a68b-db676aac0b27 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] 10.222.0.87 "GET /compute/v2.1/servers/f69664c9-6a0c-4807-a429-f39a1823f6ac" status: 200 len: 1266 microversion: 2.1 time: 0.236341 Oct 29 01:34:13.609772 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 406/821] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:34:13 2021] GET /compute/v2.1/servers/f69664c9-6a0c-4807-a429-f39a1823f6ac => generated 1266 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:34:14.079353 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-837e5529-8bb1-4134-9613-78bfd64c7cf8 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:14.080192 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-837e5529-8bb1-4134-9613-78bfd64c7cf8 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:14.085785 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-837e5529-8bb1-4134-9613-78bfd64c7cf8 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:14.086229 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-837e5529-8bb1-4134-9613-78bfd64c7cf8 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:14.086995 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-837e5529-8bb1-4134-9613-78bfd64c7cf8 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:14.087422 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-837e5529-8bb1-4134-9613-78bfd64c7cf8 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:14.124147 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-2b2cd92b-5ea3-4f17-8a58-e9bf2efd4c21 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:14.125353 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-2b2cd92b-5ea3-4f17-8a58-e9bf2efd4c21 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: ba08d2b5-ae9e-43db-b376-18011c8863f6] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:14.135986 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-2b2cd92b-5ea3-4f17-8a58-e9bf2efd4c21 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:14.136629 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-2b2cd92b-5ea3-4f17-8a58-e9bf2efd4c21 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:14.140050 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-2b2cd92b-5ea3-4f17-8a58-e9bf2efd4c21 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:14.140050 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-2b2cd92b-5ea3-4f17-8a58-e9bf2efd4c21 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:14.266497 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-837e5529-8bb1-4134-9613-78bfd64c7cf8 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:14.274517 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-837e5529-8bb1-4134-9613-78bfd64c7cf8 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:14.276133 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-837e5529-8bb1-4134-9613-78bfd64c7cf8 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:14.277247 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-837e5529-8bb1-4134-9613-78bfd64c7cf8 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a" status: 200 len: 1406 microversion: 2.20 time: 0.311763 Oct 29 01:34:14.277801 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 416/822] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:34:13 2021] GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a => generated 1406 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:34:14.303591 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-2b2cd92b-5ea3-4f17-8a58-e9bf2efd4c21 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045dda1ff9b44334954c08e63fcd20c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51a2093a0874d52a08f6e25489ba181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:14.312487 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-2b2cd92b-5ea3-4f17-8a58-e9bf2efd4c21 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6" status: 200 len: 1361 microversion: 2.1 time: 0.314305 Oct 29 01:34:14.313201 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 407/823] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:34:13 2021] GET /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6 => generated 1361 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:34:14.632172 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-efe5baaa-233e-4f1e-a8e8-84f13df66591 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:14.632686 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-efe5baaa-233e-4f1e-a8e8-84f13df66591 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] [instance: f69664c9-6a0c-4807-a429-f39a1823f6ac] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:14.638530 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-efe5baaa-233e-4f1e-a8e8-84f13df66591 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:14.638968 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-efe5baaa-233e-4f1e-a8e8-84f13df66591 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:14.640766 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-efe5baaa-233e-4f1e-a8e8-84f13df66591 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:14.641216 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-efe5baaa-233e-4f1e-a8e8-84f13df66591 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:14.761242 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-efe5baaa-233e-4f1e-a8e8-84f13df66591 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef8571ef39b4efe8f510a28052e2b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84bceeeb4f67456a90779360ffc620aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:14.770269 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-efe5baaa-233e-4f1e-a8e8-84f13df66591 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] 10.222.0.87 "GET /compute/v2.1/servers/f69664c9-6a0c-4807-a429-f39a1823f6ac" status: 200 len: 1266 microversion: 2.1 time: 0.141787 Oct 29 01:34:14.770832 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 417/824] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:34:14 2021] GET /compute/v2.1/servers/f69664c9-6a0c-4807-a429-f39a1823f6ac => generated 1266 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:34:15.295025 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-2bd06bd6-794d-4e75-9c95-0f4ce08ab518 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:15.296066 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-2bd06bd6-794d-4e75-9c95-0f4ce08ab518 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:15.302158 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-2bd06bd6-794d-4e75-9c95-0f4ce08ab518 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:15.302596 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-2bd06bd6-794d-4e75-9c95-0f4ce08ab518 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:15.303359 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-2bd06bd6-794d-4e75-9c95-0f4ce08ab518 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:15.303803 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-2bd06bd6-794d-4e75-9c95-0f4ce08ab518 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:15.330453 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-c936bb7d-c531-4cb0-8859-9604c3dd8ac6 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:15.331065 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-c936bb7d-c531-4cb0-8859-9604c3dd8ac6 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: ba08d2b5-ae9e-43db-b376-18011c8863f6] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:15.338973 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c936bb7d-c531-4cb0-8859-9604c3dd8ac6 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:15.340051 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c936bb7d-c531-4cb0-8859-9604c3dd8ac6 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:15.340845 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c936bb7d-c531-4cb0-8859-9604c3dd8ac6 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:15.341371 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c936bb7d-c531-4cb0-8859-9604c3dd8ac6 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:15.507192 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-2bd06bd6-794d-4e75-9c95-0f4ce08ab518 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:15.516108 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-2bd06bd6-794d-4e75-9c95-0f4ce08ab518 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:15.517744 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-2bd06bd6-794d-4e75-9c95-0f4ce08ab518 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:15.518837 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-2bd06bd6-794d-4e75-9c95-0f4ce08ab518 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a" status: 200 len: 1406 microversion: 2.20 time: 0.227575 Oct 29 01:34:15.519395 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 408/825] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:34:15 2021] GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a => generated 1406 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:34:15.532636 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-c936bb7d-c531-4cb0-8859-9604c3dd8ac6 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045dda1ff9b44334954c08e63fcd20c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51a2093a0874d52a08f6e25489ba181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:15.540116 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-c936bb7d-c531-4cb0-8859-9604c3dd8ac6 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6" status: 200 len: 1361 microversion: 2.1 time: 0.214043 Oct 29 01:34:15.540713 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 418/826] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:34:15 2021] GET /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6 => generated 1361 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:34:15.786653 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-4af3721b-297f-4fbd-aeaf-47229dafe51a tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:15.787254 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-4af3721b-297f-4fbd-aeaf-47229dafe51a tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] [instance: f69664c9-6a0c-4807-a429-f39a1823f6ac] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:15.793127 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-4af3721b-297f-4fbd-aeaf-47229dafe51a tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:15.793612 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-4af3721b-297f-4fbd-aeaf-47229dafe51a tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:15.794364 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-4af3721b-297f-4fbd-aeaf-47229dafe51a tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:15.794796 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-4af3721b-297f-4fbd-aeaf-47229dafe51a tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:15.917020 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-4af3721b-297f-4fbd-aeaf-47229dafe51a tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef8571ef39b4efe8f510a28052e2b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84bceeeb4f67456a90779360ffc620aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:15.924785 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-4af3721b-297f-4fbd-aeaf-47229dafe51a tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] 10.222.0.87 "GET /compute/v2.1/servers/f69664c9-6a0c-4807-a429-f39a1823f6ac" status: 200 len: 1266 microversion: 2.1 time: 0.141793 Oct 29 01:34:15.925351 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 409/827] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:34:15 2021] GET /compute/v2.1/servers/f69664c9-6a0c-4807-a429-f39a1823f6ac => generated 1266 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:34:16.536563 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-66cc52fd-f868-4603-b787-5aec6688dca9 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:16.537145 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-66cc52fd-f868-4603-b787-5aec6688dca9 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:16.543355 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-66cc52fd-f868-4603-b787-5aec6688dca9 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:16.543836 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-66cc52fd-f868-4603-b787-5aec6688dca9 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:16.544596 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-66cc52fd-f868-4603-b787-5aec6688dca9 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:16.545022 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-66cc52fd-f868-4603-b787-5aec6688dca9 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:16.556656 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-298e1201-735e-4c35-ae07-4cc0e8f9a87a tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:16.557247 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-298e1201-735e-4c35-ae07-4cc0e8f9a87a tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: ba08d2b5-ae9e-43db-b376-18011c8863f6] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:16.563447 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-298e1201-735e-4c35-ae07-4cc0e8f9a87a tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:16.563927 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-298e1201-735e-4c35-ae07-4cc0e8f9a87a tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:16.564689 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-298e1201-735e-4c35-ae07-4cc0e8f9a87a tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:16.565112 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-298e1201-735e-4c35-ae07-4cc0e8f9a87a tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:16.730736 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-66cc52fd-f868-4603-b787-5aec6688dca9 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:16.733260 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-298e1201-735e-4c35-ae07-4cc0e8f9a87a tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045dda1ff9b44334954c08e63fcd20c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51a2093a0874d52a08f6e25489ba181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:16.739392 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-66cc52fd-f868-4603-b787-5aec6688dca9 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:16.740709 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-298e1201-735e-4c35-ae07-4cc0e8f9a87a tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6" status: 200 len: 1361 microversion: 2.1 time: 0.187706 Oct 29 01:34:16.740937 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-66cc52fd-f868-4603-b787-5aec6688dca9 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:16.741278 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 410/828] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:34:16 2021] GET /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6 => generated 1361 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:34:16.742079 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-66cc52fd-f868-4603-b787-5aec6688dca9 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a" status: 200 len: 1406 microversion: 2.20 time: 0.209202 Oct 29 01:34:16.742626 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 419/829] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:34:16 2021] GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a => generated 1406 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:34:16.942222 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-fb887078-2eec-438a-b035-66d44fbe2f72 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:16.942856 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-fb887078-2eec-438a-b035-66d44fbe2f72 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] [instance: f69664c9-6a0c-4807-a429-f39a1823f6ac] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:16.948906 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-fb887078-2eec-438a-b035-66d44fbe2f72 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:16.949359 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-fb887078-2eec-438a-b035-66d44fbe2f72 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:16.950155 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-fb887078-2eec-438a-b035-66d44fbe2f72 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:16.950626 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-fb887078-2eec-438a-b035-66d44fbe2f72 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:17.102556 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-fb887078-2eec-438a-b035-66d44fbe2f72 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef8571ef39b4efe8f510a28052e2b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84bceeeb4f67456a90779360ffc620aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:17.110050 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-fb887078-2eec-438a-b035-66d44fbe2f72 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] 10.222.0.87 "GET /compute/v2.1/servers/f69664c9-6a0c-4807-a429-f39a1823f6ac" status: 200 len: 1266 microversion: 2.1 time: 0.171662 Oct 29 01:34:17.110645 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 411/830] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:34:16 2021] GET /compute/v2.1/servers/f69664c9-6a0c-4807-a429-f39a1823f6ac => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:34:17.757451 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-81884066-34c5-4dc7-ab2f-6228f1977206 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:17.758001 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-81884066-34c5-4dc7-ab2f-6228f1977206 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: ba08d2b5-ae9e-43db-b376-18011c8863f6] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:17.760073 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-84536b09-762e-44b2-9439-b738189cb8b5 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:17.760676 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-84536b09-762e-44b2-9439-b738189cb8b5 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:17.764321 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-81884066-34c5-4dc7-ab2f-6228f1977206 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:17.764774 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-81884066-34c5-4dc7-ab2f-6228f1977206 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:17.765551 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-81884066-34c5-4dc7-ab2f-6228f1977206 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:17.765977 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-81884066-34c5-4dc7-ab2f-6228f1977206 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:17.766800 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-84536b09-762e-44b2-9439-b738189cb8b5 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:17.767250 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-84536b09-762e-44b2-9439-b738189cb8b5 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:17.768042 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-84536b09-762e-44b2-9439-b738189cb8b5 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:17.768679 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-84536b09-762e-44b2-9439-b738189cb8b5 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:17.948678 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-81884066-34c5-4dc7-ab2f-6228f1977206 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045dda1ff9b44334954c08e63fcd20c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51a2093a0874d52a08f6e25489ba181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:17.951117 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-84536b09-762e-44b2-9439-b738189cb8b5 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:17.956872 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-81884066-34c5-4dc7-ab2f-6228f1977206 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6" status: 200 len: 1361 microversion: 2.1 time: 0.203244 Oct 29 01:34:17.957455 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 420/831] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:34:17 2021] GET /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6 => generated 1361 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:34:17.959911 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-84536b09-762e-44b2-9439-b738189cb8b5 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:17.961660 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-84536b09-762e-44b2-9439-b738189cb8b5 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:17.962766 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-84536b09-762e-44b2-9439-b738189cb8b5 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a" status: 200 len: 1406 microversion: 2.20 time: 0.206495 Oct 29 01:34:17.963321 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 412/832] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:34:17 2021] GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a => generated 1406 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:34:18.126769 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-2a4338e9-bd6d-4ea6-8d19-b1353f6907e3 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:18.135771 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-2a4338e9-bd6d-4ea6-8d19-b1353f6907e3 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] [instance: f69664c9-6a0c-4807-a429-f39a1823f6ac] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:18.135771 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-2a4338e9-bd6d-4ea6-8d19-b1353f6907e3 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:18.135771 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-2a4338e9-bd6d-4ea6-8d19-b1353f6907e3 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:18.135771 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-2a4338e9-bd6d-4ea6-8d19-b1353f6907e3 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:18.136211 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-2a4338e9-bd6d-4ea6-8d19-b1353f6907e3 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:18.261779 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-2a4338e9-bd6d-4ea6-8d19-b1353f6907e3 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef8571ef39b4efe8f510a28052e2b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84bceeeb4f67456a90779360ffc620aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:18.270155 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-2a4338e9-bd6d-4ea6-8d19-b1353f6907e3 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] 10.222.0.87 "GET /compute/v2.1/servers/f69664c9-6a0c-4807-a429-f39a1823f6ac" status: 200 len: 1266 microversion: 2.1 time: 0.147664 Oct 29 01:34:18.270722 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 421/833] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:34:18 2021] GET /compute/v2.1/servers/f69664c9-6a0c-4807-a429-f39a1823f6ac => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:34:18.974494 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-cda608dd-c5c0-4bb7-a415-5e626891ba52 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:18.975096 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-cda608dd-c5c0-4bb7-a415-5e626891ba52 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: ba08d2b5-ae9e-43db-b376-18011c8863f6] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:18.980307 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-7c3e305b-fe87-431f-ac54-f2f658956338 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:18.981350 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-7c3e305b-fe87-431f-ac54-f2f658956338 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:18.981477 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-cda608dd-c5c0-4bb7-a415-5e626891ba52 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:18.981811 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-cda608dd-c5c0-4bb7-a415-5e626891ba52 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:18.982571 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-cda608dd-c5c0-4bb7-a415-5e626891ba52 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:18.983034 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-cda608dd-c5c0-4bb7-a415-5e626891ba52 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:18.988213 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-7c3e305b-fe87-431f-ac54-f2f658956338 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:18.988764 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-7c3e305b-fe87-431f-ac54-f2f658956338 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:18.989535 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-7c3e305b-fe87-431f-ac54-f2f658956338 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:18.989970 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-7c3e305b-fe87-431f-ac54-f2f658956338 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:19.164618 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-cda608dd-c5c0-4bb7-a415-5e626891ba52 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045dda1ff9b44334954c08e63fcd20c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51a2093a0874d52a08f6e25489ba181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:19.167084 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-7c3e305b-fe87-431f-ac54-f2f658956338 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:19.172455 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-cda608dd-c5c0-4bb7-a415-5e626891ba52 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6" status: 200 len: 1361 microversion: 2.1 time: 0.201668 Oct 29 01:34:19.178282 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 413/834] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:34:18 2021] GET /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6 => generated 1361 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:34:19.178397 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-7c3e305b-fe87-431f-ac54-f2f658956338 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:19.178397 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-7c3e305b-fe87-431f-ac54-f2f658956338 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:19.178397 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-7c3e305b-fe87-431f-ac54-f2f658956338 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a" status: 200 len: 1406 microversion: 2.20 time: 0.201604 Oct 29 01:34:19.179364 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 422/835] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:34:18 2021] GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a => generated 1406 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:34:19.287062 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-8e08a2d1-4d72-4b08-9da5-65e69ca4cdc7 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:19.287649 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-8e08a2d1-4d72-4b08-9da5-65e69ca4cdc7 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] [instance: f69664c9-6a0c-4807-a429-f39a1823f6ac] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:19.293514 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-8e08a2d1-4d72-4b08-9da5-65e69ca4cdc7 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:19.293952 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-8e08a2d1-4d72-4b08-9da5-65e69ca4cdc7 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:19.294712 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-8e08a2d1-4d72-4b08-9da5-65e69ca4cdc7 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:19.295139 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-8e08a2d1-4d72-4b08-9da5-65e69ca4cdc7 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:19.415307 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-8e08a2d1-4d72-4b08-9da5-65e69ca4cdc7 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef8571ef39b4efe8f510a28052e2b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84bceeeb4f67456a90779360ffc620aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:19.423206 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-8e08a2d1-4d72-4b08-9da5-65e69ca4cdc7 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] 10.222.0.87 "GET /compute/v2.1/servers/f69664c9-6a0c-4807-a429-f39a1823f6ac" status: 200 len: 1266 microversion: 2.1 time: 0.139855 Oct 29 01:34:19.423785 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 414/836] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:34:19 2021] GET /compute/v2.1/servers/f69664c9-6a0c-4807-a429-f39a1823f6ac => generated 1266 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:34:20.193219 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-032be08b-023e-4a50-bc8c-c6bc02cfea5f tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:20.193853 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-032be08b-023e-4a50-bc8c-c6bc02cfea5f tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: ba08d2b5-ae9e-43db-b376-18011c8863f6] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:20.196571 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-d4d7e0aa-1ed2-4f6a-8455-e4bc06b10d9f tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:20.197253 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-d4d7e0aa-1ed2-4f6a-8455-e4bc06b10d9f tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:20.200388 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-032be08b-023e-4a50-bc8c-c6bc02cfea5f tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:20.200885 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-032be08b-023e-4a50-bc8c-c6bc02cfea5f tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:20.202323 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-032be08b-023e-4a50-bc8c-c6bc02cfea5f tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:20.204057 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-032be08b-023e-4a50-bc8c-c6bc02cfea5f tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:20.204258 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d4d7e0aa-1ed2-4f6a-8455-e4bc06b10d9f tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:20.204700 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d4d7e0aa-1ed2-4f6a-8455-e4bc06b10d9f tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:20.205454 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d4d7e0aa-1ed2-4f6a-8455-e4bc06b10d9f tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:20.205885 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d4d7e0aa-1ed2-4f6a-8455-e4bc06b10d9f tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:20.398928 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-032be08b-023e-4a50-bc8c-c6bc02cfea5f tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045dda1ff9b44334954c08e63fcd20c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51a2093a0874d52a08f6e25489ba181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:20.404807 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-d4d7e0aa-1ed2-4f6a-8455-e4bc06b10d9f tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:20.406956 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-032be08b-023e-4a50-bc8c-c6bc02cfea5f tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6" status: 200 len: 1361 microversion: 2.1 time: 0.217409 Oct 29 01:34:20.407526 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 423/837] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:34:20 2021] GET /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6 => generated 1361 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:34:20.413360 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-d4d7e0aa-1ed2-4f6a-8455-e4bc06b10d9f tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:20.414831 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-d4d7e0aa-1ed2-4f6a-8455-e4bc06b10d9f tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:20.415968 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-d4d7e0aa-1ed2-4f6a-8455-e4bc06b10d9f tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a" status: 200 len: 1406 microversion: 2.20 time: 0.223146 Oct 29 01:34:20.416506 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 415/838] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:34:20 2021] GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a => generated 1406 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:34:20.440271 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-b0db8fe6-ee21-43f4-ad80-b8a13fbe057c tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:20.441028 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-b0db8fe6-ee21-43f4-ad80-b8a13fbe057c tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] [instance: f69664c9-6a0c-4807-a429-f39a1823f6ac] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:20.446841 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-b0db8fe6-ee21-43f4-ad80-b8a13fbe057c tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:20.447283 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-b0db8fe6-ee21-43f4-ad80-b8a13fbe057c tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:20.448149 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-b0db8fe6-ee21-43f4-ad80-b8a13fbe057c tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:20.448576 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-b0db8fe6-ee21-43f4-ad80-b8a13fbe057c tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:20.580999 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-b0db8fe6-ee21-43f4-ad80-b8a13fbe057c tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef8571ef39b4efe8f510a28052e2b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84bceeeb4f67456a90779360ffc620aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:20.588915 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-b0db8fe6-ee21-43f4-ad80-b8a13fbe057c tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] 10.222.0.87 "GET /compute/v2.1/servers/f69664c9-6a0c-4807-a429-f39a1823f6ac" status: 200 len: 1266 microversion: 2.1 time: 0.152815 Oct 29 01:34:20.589583 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 424/839] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:34:20 2021] GET /compute/v2.1/servers/f69664c9-6a0c-4807-a429-f39a1823f6ac => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:34:20.891970 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [req-25ed8ad3-026c-449b-8e98-440a8a3b88c1 req-6de79275-5e95-4cb7-a0ae-5542f6a61882 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91b62925-d26a-4afb-bab2-c0288f74404a", "name": "network-vif-plugged", "status": "completed", "tag": "aee32650-07ba-4e45-a318-0849274af2bf"}]} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:34:20.893580 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:34:20.893580 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: warnings.warn(msg) Oct 29 01:34:20.900659 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [req-25ed8ad3-026c-449b-8e98-440a8a3b88c1 req-6de79275-5e95-4cb7-a0ae-5542f6a61882 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:20.901101 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [req-25ed8ad3-026c-449b-8e98-440a8a3b88c1 req-6de79275-5e95-4cb7-a0ae-5542f6a61882 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:20.913065 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.compute.server_external_events [req-25ed8ad3-026c-449b-8e98-440a8a3b88c1 req-6de79275-5e95-4cb7-a0ae-5542f6a61882 service nova] Creating event network-vif-plugged:aee32650-07ba-4e45-a318-0849274af2bf for instance 91b62925-d26a-4afb-bab2-c0288f74404a on hv-cinder-81398 Oct 29 01:34:20.918248 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [req-25ed8ad3-026c-449b-8e98-440a8a3b88c1 req-6de79275-5e95-4cb7-a0ae-5542f6a61882 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031243 Oct 29 01:34:20.918903 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 416/840] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Oct 29 01:34:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:34:21.424787 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-94099e4d-afe5-4181-92de-0a0e609c49e4 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:21.425934 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-94099e4d-afe5-4181-92de-0a0e609c49e4 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: ba08d2b5-ae9e-43db-b376-18011c8863f6] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:21.434000 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-94099e4d-afe5-4181-92de-0a0e609c49e4 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:21.434457 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-94099e4d-afe5-4181-92de-0a0e609c49e4 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:21.435221 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-94099e4d-afe5-4181-92de-0a0e609c49e4 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:21.435612 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-45dd6086-1c41-47dc-93c4-1884a0ca6177 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:21.438665 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-45dd6086-1c41-47dc-93c4-1884a0ca6177 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:21.439185 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-94099e4d-afe5-4181-92de-0a0e609c49e4 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:21.445050 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-45dd6086-1c41-47dc-93c4-1884a0ca6177 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:21.445503 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-45dd6086-1c41-47dc-93c4-1884a0ca6177 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:21.446364 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-45dd6086-1c41-47dc-93c4-1884a0ca6177 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:21.446723 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-45dd6086-1c41-47dc-93c4-1884a0ca6177 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:21.649584 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-94099e4d-afe5-4181-92de-0a0e609c49e4 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045dda1ff9b44334954c08e63fcd20c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51a2093a0874d52a08f6e25489ba181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:21.656967 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-45dd6086-1c41-47dc-93c4-1884a0ca6177 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:21.667109 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-94099e4d-afe5-4181-92de-0a0e609c49e4 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6" status: 200 len: 1361 microversion: 2.1 time: 0.246933 Oct 29 01:34:21.668168 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-45dd6086-1c41-47dc-93c4-1884a0ca6177 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:21.677204 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-45dd6086-1c41-47dc-93c4-1884a0ca6177 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:21.677204 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-45dd6086-1c41-47dc-93c4-1884a0ca6177 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a" status: 200 len: 1406 microversion: 2.20 time: 0.240255 Oct 29 01:34:21.677204 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 417/841] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:34:21 2021] GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a => generated 1406 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:34:21.677516 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 425/842] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:34:21 2021] GET /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6 => generated 1361 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:34:21.680415 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-8588210e-06cd-46b4-9e27-832694fe83a3 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:21.681079 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-8588210e-06cd-46b4-9e27-832694fe83a3 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] [instance: f69664c9-6a0c-4807-a429-f39a1823f6ac] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:21.688279 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-8588210e-06cd-46b4-9e27-832694fe83a3 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:21.688736 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-8588210e-06cd-46b4-9e27-832694fe83a3 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:21.689513 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-8588210e-06cd-46b4-9e27-832694fe83a3 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:21.690054 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-8588210e-06cd-46b4-9e27-832694fe83a3 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:21.823323 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-8588210e-06cd-46b4-9e27-832694fe83a3 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef8571ef39b4efe8f510a28052e2b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84bceeeb4f67456a90779360ffc620aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:21.831391 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-8588210e-06cd-46b4-9e27-832694fe83a3 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] 10.222.0.87 "GET /compute/v2.1/servers/f69664c9-6a0c-4807-a429-f39a1823f6ac" status: 200 len: 1452 microversion: 2.1 time: 0.158870 Oct 29 01:34:21.831988 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 418/843] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:34:21 2021] GET /compute/v2.1/servers/f69664c9-6a0c-4807-a429-f39a1823f6ac => generated 1452 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:34:21.850978 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-c512e27b-bfbb-4f2e-8982-de46b29edee0 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:21.851599 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-c512e27b-bfbb-4f2e-8982-de46b29edee0 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] [instance: f69664c9-6a0c-4807-a429-f39a1823f6ac] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:21.857552 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c512e27b-bfbb-4f2e-8982-de46b29edee0 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:21.858491 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c512e27b-bfbb-4f2e-8982-de46b29edee0 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:21.859248 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c512e27b-bfbb-4f2e-8982-de46b29edee0 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:21.859701 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c512e27b-bfbb-4f2e-8982-de46b29edee0 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:21.984698 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-c512e27b-bfbb-4f2e-8982-de46b29edee0 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef8571ef39b4efe8f510a28052e2b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84bceeeb4f67456a90779360ffc620aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:21.991907 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-c512e27b-bfbb-4f2e-8982-de46b29edee0 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] 10.222.0.87 "GET /compute/v2.1/servers/f69664c9-6a0c-4807-a429-f39a1823f6ac" status: 200 len: 1452 microversion: 2.1 time: 0.145314 Oct 29 01:34:21.992475 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 426/844] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:34:21 2021] GET /compute/v2.1/servers/f69664c9-6a0c-4807-a429-f39a1823f6ac => generated 1452 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:34:22.685061 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-816dc263-cc95-47de-8959-8b1869e5845a tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:22.685670 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-816dc263-cc95-47de-8959-8b1869e5845a tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: ba08d2b5-ae9e-43db-b376-18011c8863f6] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:22.688516 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-c703ff7f-fb33-43a6-badc-ab9c94a725b2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:22.689278 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-c703ff7f-fb33-43a6-badc-ab9c94a725b2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:22.692439 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-816dc263-cc95-47de-8959-8b1869e5845a tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:22.692960 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-816dc263-cc95-47de-8959-8b1869e5845a tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:22.693726 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-816dc263-cc95-47de-8959-8b1869e5845a tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:22.694223 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-816dc263-cc95-47de-8959-8b1869e5845a tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:22.695469 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c703ff7f-fb33-43a6-badc-ab9c94a725b2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:22.695949 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c703ff7f-fb33-43a6-badc-ab9c94a725b2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:22.696743 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c703ff7f-fb33-43a6-badc-ab9c94a725b2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:22.697169 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c703ff7f-fb33-43a6-badc-ab9c94a725b2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:22.999182 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-816dc263-cc95-47de-8959-8b1869e5845a tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045dda1ff9b44334954c08e63fcd20c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51a2093a0874d52a08f6e25489ba181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:23.009161 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-816dc263-cc95-47de-8959-8b1869e5845a tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6" status: 200 len: 1361 microversion: 2.1 time: 0.325604 Oct 29 01:34:23.009161 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 419/845] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:34:22 2021] GET /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6 => generated 1361 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:34:23.009392 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-c703ff7f-fb33-43a6-badc-ab9c94a725b2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:23.014147 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [req-64a3dcec-9540-4d27-b03a-d8717e66313b req-076e308f-094d-479e-b3e9-c83473ef7835 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba08d2b5-ae9e-43db-b376-18011c8863f6", "name": "network-vif-plugged", "status": "completed", "tag": "334d5ed1-db63-42dc-bee7-9a695829f7de"}]} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:34:23.017325 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:34:23.017325 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: warnings.warn(msg) Oct 29 01:34:23.024162 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-c703ff7f-fb33-43a6-badc-ab9c94a725b2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:23.024763 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [req-64a3dcec-9540-4d27-b03a-d8717e66313b req-076e308f-094d-479e-b3e9-c83473ef7835 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:23.025416 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [req-64a3dcec-9540-4d27-b03a-d8717e66313b req-076e308f-094d-479e-b3e9-c83473ef7835 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:23.026006 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-c703ff7f-fb33-43a6-badc-ab9c94a725b2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:23.027412 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-c703ff7f-fb33-43a6-badc-ab9c94a725b2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a" status: 200 len: 1406 microversion: 2.20 time: 0.342835 Oct 29 01:34:23.028128 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 427/846] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:34:22 2021] GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a => generated 1406 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:34:23.036765 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.compute.server_external_events [req-64a3dcec-9540-4d27-b03a-d8717e66313b req-076e308f-094d-479e-b3e9-c83473ef7835 service nova] Creating event network-vif-plugged:334d5ed1-db63-42dc-bee7-9a695829f7de for instance ba08d2b5-ae9e-43db-b376-18011c8863f6 on hv-cinder-81398 Oct 29 01:34:23.041737 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [req-64a3dcec-9540-4d27-b03a-d8717e66313b req-076e308f-094d-479e-b3e9-c83473ef7835 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033295 Oct 29 01:34:23.042438 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 420/847] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Oct 29 01:34:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:34:24.024149 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-85a38d16-23d4-4c6e-bfe1-ea9b4ed4bcd1 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:24.024942 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-85a38d16-23d4-4c6e-bfe1-ea9b4ed4bcd1 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: ba08d2b5-ae9e-43db-b376-18011c8863f6] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:24.032223 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-85a38d16-23d4-4c6e-bfe1-ea9b4ed4bcd1 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:24.032660 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-85a38d16-23d4-4c6e-bfe1-ea9b4ed4bcd1 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:24.041833 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-85a38d16-23d4-4c6e-bfe1-ea9b4ed4bcd1 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:24.041833 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-85a38d16-23d4-4c6e-bfe1-ea9b4ed4bcd1 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:24.047048 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-397657e1-d7aa-4985-a12b-5db7a6abd99e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:24.047751 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-397657e1-d7aa-4985-a12b-5db7a6abd99e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:24.055078 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-397657e1-d7aa-4985-a12b-5db7a6abd99e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:24.055929 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-397657e1-d7aa-4985-a12b-5db7a6abd99e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:24.056719 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-397657e1-d7aa-4985-a12b-5db7a6abd99e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:24.057192 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-397657e1-d7aa-4985-a12b-5db7a6abd99e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:24.500422 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-397657e1-d7aa-4985-a12b-5db7a6abd99e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:24.508800 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-397657e1-d7aa-4985-a12b-5db7a6abd99e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:24.510302 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-397657e1-d7aa-4985-a12b-5db7a6abd99e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:24.511445 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-397657e1-d7aa-4985-a12b-5db7a6abd99e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a" status: 200 len: 1599 microversion: 2.20 time: 0.469559 Oct 29 01:34:24.512029 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 421/848] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:34:24 2021] GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a => generated 1599 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:34:24.519359 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-85a38d16-23d4-4c6e-bfe1-ea9b4ed4bcd1 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045dda1ff9b44334954c08e63fcd20c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51a2093a0874d52a08f6e25489ba181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:24.527810 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-85a38d16-23d4-4c6e-bfe1-ea9b4ed4bcd1 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6" status: 200 len: 1361 microversion: 2.1 time: 0.507390 Oct 29 01:34:24.528633 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 428/849] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:34:24 2021] GET /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6 => generated 1361 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:34:24.531244 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-7b05651e-5368-475d-a61d-8cf2f6003490 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:24.531752 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-7b05651e-5368-475d-a61d-8cf2f6003490 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:24.537555 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-7b05651e-5368-475d-a61d-8cf2f6003490 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:24.537998 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-7b05651e-5368-475d-a61d-8cf2f6003490 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:24.538764 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-7b05651e-5368-475d-a61d-8cf2f6003490 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:24.539193 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-7b05651e-5368-475d-a61d-8cf2f6003490 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:24.680526 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-7b05651e-5368-475d-a61d-8cf2f6003490 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.153398 Oct 29 01:34:24.681143 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 422/850] 10.222.0.87 () {60 vars in 1315 bytes} [Fri Oct 29 01:34:24 2021] GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a/os-interface => generated 285 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 01:34:25.102465 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [req-a1d0d529-76f6-452c-8175-e70fa9b18325 req-45c29fcf-347a-4c6b-9e99-506f87d859b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f69664c9-6a0c-4807-a429-f39a1823f6ac", "tag": "569ffd45-8958-4842-9d3e-75bdbaf74160"}]} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:34:25.104034 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:34:25.104034 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: warnings.warn(msg) Oct 29 01:34:25.111909 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [req-a1d0d529-76f6-452c-8175-e70fa9b18325 req-45c29fcf-347a-4c6b-9e99-506f87d859b4 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:25.112347 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [req-a1d0d529-76f6-452c-8175-e70fa9b18325 req-45c29fcf-347a-4c6b-9e99-506f87d859b4 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:25.124395 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.compute.server_external_events [req-a1d0d529-76f6-452c-8175-e70fa9b18325 req-45c29fcf-347a-4c6b-9e99-506f87d859b4 service nova] Creating event network-changed:569ffd45-8958-4842-9d3e-75bdbaf74160 for instance f69664c9-6a0c-4807-a429-f39a1823f6ac on hv-cinder-81398 Oct 29 01:34:25.129981 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [req-a1d0d529-76f6-452c-8175-e70fa9b18325 req-45c29fcf-347a-4c6b-9e99-506f87d859b4 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106973 Oct 29 01:34:25.130655 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 429/851] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Oct 29 01:34:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:34:25.545141 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-7c218c3c-ab3d-42f8-a95b-ed10935a3ceb tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:25.545847 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-7c218c3c-ab3d-42f8-a95b-ed10935a3ceb tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: ba08d2b5-ae9e-43db-b376-18011c8863f6] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:25.555875 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-7c218c3c-ab3d-42f8-a95b-ed10935a3ceb tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:25.559318 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-7c218c3c-ab3d-42f8-a95b-ed10935a3ceb tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:25.559318 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-7c218c3c-ab3d-42f8-a95b-ed10935a3ceb tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:25.559318 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-7c218c3c-ab3d-42f8-a95b-ed10935a3ceb tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:25.815694 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-7c218c3c-ab3d-42f8-a95b-ed10935a3ceb tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045dda1ff9b44334954c08e63fcd20c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51a2093a0874d52a08f6e25489ba181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:25.834136 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-7c218c3c-ab3d-42f8-a95b-ed10935a3ceb tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6" status: 200 len: 1546 microversion: 2.1 time: 0.293548 Oct 29 01:34:25.839177 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 423/852] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:34:25 2021] GET /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6 => generated 1546 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:34:25.860271 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-f94b80a0-8667-44c0-bef4-35bcddeccf45 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:34:25.861727 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-f94b80a0-8667-44c0-bef4-35bcddeccf45 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:25.864322 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-4101f58a-fc2b-4418-8eef-9554f5b31108 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:25.865036 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-4101f58a-fc2b-4418-8eef-9554f5b31108 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: ba08d2b5-ae9e-43db-b376-18011c8863f6] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:25.873056 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-f94b80a0-8667-44c0-bef4-35bcddeccf45 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:25.874045 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-f94b80a0-8667-44c0-bef4-35bcddeccf45 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:25.879411 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-f94b80a0-8667-44c0-bef4-35bcddeccf45 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:25.880095 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-f94b80a0-8667-44c0-bef4-35bcddeccf45 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:25.886026 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-4101f58a-fc2b-4418-8eef-9554f5b31108 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:25.887044 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-4101f58a-fc2b-4418-8eef-9554f5b31108 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:25.888137 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-4101f58a-fc2b-4418-8eef-9554f5b31108 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:25.888647 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-4101f58a-fc2b-4418-8eef-9554f5b31108 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:25.999695 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-f94b80a0-8667-44c0-bef4-35bcddeccf45 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "POST /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a/action" status: 200 len: 14 microversion: 2.20 time: 0.140055 Oct 29 01:34:26.000322 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 430/853] 10.222.0.87 () {62 vars in 1318 bytes} [Fri Oct 29 01:34:25 2021] POST /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a/action => generated 14 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:34:26.004308 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-4101f58a-fc2b-4418-8eef-9554f5b31108 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.146877 Oct 29 01:34:26.004308 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 424/854] 10.222.0.87 () {58 vars in 1274 bytes} [Fri Oct 29 01:34:25 2021] GET /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6/os-interface => generated 284 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:34:26.008242 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [req-947bf3e5-5457-42ed-b05e-c9d805720e0e req-0ab734b4-480f-420a-9ed3-84b3209021ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91b62925-d26a-4afb-bab2-c0288f74404a", "tag": "aee32650-07ba-4e45-a318-0849274af2bf"}]} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:34:26.013512 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:34:26.013512 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: warnings.warn(msg) Oct 29 01:34:26.026554 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [req-947bf3e5-5457-42ed-b05e-c9d805720e0e req-0ab734b4-480f-420a-9ed3-84b3209021ec service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:26.027323 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [req-947bf3e5-5457-42ed-b05e-c9d805720e0e req-0ab734b4-480f-420a-9ed3-84b3209021ec service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:26.040999 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.compute.server_external_events [req-947bf3e5-5457-42ed-b05e-c9d805720e0e req-0ab734b4-480f-420a-9ed3-84b3209021ec service nova] Creating event network-changed:aee32650-07ba-4e45-a318-0849274af2bf for instance 91b62925-d26a-4afb-bab2-c0288f74404a on hv-cinder-81398 Oct 29 01:34:26.046779 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [req-947bf3e5-5457-42ed-b05e-c9d805720e0e req-0ab734b4-480f-420a-9ed3-84b3209021ec service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044748 Oct 29 01:34:26.048273 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 431/855] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Oct 29 01:34:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:34:27.009446 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-7d6daf15-728b-4f7c-a650-6e6d590ff336 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:34:27.011022 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-7d6daf15-728b-4f7c-a650-6e6d590ff336 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:27.018588 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-7d6daf15-728b-4f7c-a650-6e6d590ff336 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:27.019904 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-7d6daf15-728b-4f7c-a650-6e6d590ff336 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:27.019904 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-7d6daf15-728b-4f7c-a650-6e6d590ff336 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:27.020240 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-7d6daf15-728b-4f7c-a650-6e6d590ff336 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:27.099856 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-7d6daf15-728b-4f7c-a650-6e6d590ff336 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "POST /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a/action" status: 200 len: 14 microversion: 2.20 time: 0.094337 Oct 29 01:34:27.100763 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 425/856] 10.222.0.87 () {62 vars in 1318 bytes} [Fri Oct 29 01:34:27 2021] POST /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:34:27.341689 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-2eca9367-76f9-4fc9-bba7-e6a164e94767 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:34:27.343364 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-2eca9367-76f9-4fc9-bba7-e6a164e94767 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: ba08d2b5-ae9e-43db-b376-18011c8863f6] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:27.351874 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-2eca9367-76f9-4fc9-bba7-e6a164e94767 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:27.353206 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-2eca9367-76f9-4fc9-bba7-e6a164e94767 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:27.355297 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-2eca9367-76f9-4fc9-bba7-e6a164e94767 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:27.356295 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-2eca9367-76f9-4fc9-bba7-e6a164e94767 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:27.436413 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-2eca9367-76f9-4fc9-bba7-e6a164e94767 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "POST /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6/action" status: 200 len: 14 microversion: 2.1 time: 0.099228 Oct 29 01:34:27.437070 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 432/857] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:34:27 2021] POST /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6/action => generated 14 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:34:28.068049 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [req-f344f2bf-0314-4cc4-93d0-e19cc4541f7a req-ed7e4c5d-b71f-4de9-916a-10d327086b34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba08d2b5-ae9e-43db-b376-18011c8863f6", "tag": "334d5ed1-db63-42dc-bee7-9a695829f7de"}]} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:34:28.069354 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:34:28.069354 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: warnings.warn(msg) Oct 29 01:34:28.079190 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [req-f344f2bf-0314-4cc4-93d0-e19cc4541f7a req-ed7e4c5d-b71f-4de9-916a-10d327086b34 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:28.079944 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [req-f344f2bf-0314-4cc4-93d0-e19cc4541f7a req-ed7e4c5d-b71f-4de9-916a-10d327086b34 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:28.099044 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.compute.server_external_events [req-f344f2bf-0314-4cc4-93d0-e19cc4541f7a req-ed7e4c5d-b71f-4de9-916a-10d327086b34 service nova] Creating event network-changed:334d5ed1-db63-42dc-bee7-9a695829f7de for instance ba08d2b5-ae9e-43db-b376-18011c8863f6 on hv-cinder-81398 Oct 29 01:34:28.104107 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [req-f344f2bf-0314-4cc4-93d0-e19cc4541f7a req-ed7e4c5d-b71f-4de9-916a-10d327086b34 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040704 Oct 29 01:34:28.105975 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 426/858] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Oct 29 01:34:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:34:28.117899 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-2108d8d5-bbaf-48a3-aa4c-9adefdc3c005 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:34:28.117899 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-2108d8d5-bbaf-48a3-aa4c-9adefdc3c005 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:28.119801 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-2108d8d5-bbaf-48a3-aa4c-9adefdc3c005 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:28.120668 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-2108d8d5-bbaf-48a3-aa4c-9adefdc3c005 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:28.121696 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-2108d8d5-bbaf-48a3-aa4c-9adefdc3c005 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:28.122416 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-2108d8d5-bbaf-48a3-aa4c-9adefdc3c005 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:28.206051 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-2108d8d5-bbaf-48a3-aa4c-9adefdc3c005 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "POST /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a/action" status: 200 len: 14 microversion: 2.20 time: 0.098651 Oct 29 01:34:28.207256 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 433/859] 10.222.0.87 () {62 vars in 1318 bytes} [Fri Oct 29 01:34:28 2021] POST /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a/action => generated 14 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:34:28.448468 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-a36677b8-19db-43c6-951a-700721848ae5 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:34:28.449478 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-a36677b8-19db-43c6-951a-700721848ae5 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: ba08d2b5-ae9e-43db-b376-18011c8863f6] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:28.461390 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-a36677b8-19db-43c6-951a-700721848ae5 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:28.461390 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-a36677b8-19db-43c6-951a-700721848ae5 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:28.461390 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-a36677b8-19db-43c6-951a-700721848ae5 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:28.461390 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-a36677b8-19db-43c6-951a-700721848ae5 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:28.531257 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-a36677b8-19db-43c6-951a-700721848ae5 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "POST /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6/action" status: 200 len: 14 microversion: 2.1 time: 0.085759 Oct 29 01:34:28.535416 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 427/860] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:34:28 2021] POST /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6/action => generated 14 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:34:29.219645 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-e4c3ba24-e0d9-4655-9906-ced6717260fb tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:34:29.220868 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-e4c3ba24-e0d9-4655-9906-ced6717260fb tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:29.227643 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-e4c3ba24-e0d9-4655-9906-ced6717260fb tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:29.228133 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-e4c3ba24-e0d9-4655-9906-ced6717260fb tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:29.228905 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-e4c3ba24-e0d9-4655-9906-ced6717260fb tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:29.229336 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-e4c3ba24-e0d9-4655-9906-ced6717260fb tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:29.294658 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-e4c3ba24-e0d9-4655-9906-ced6717260fb tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "POST /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a/action" status: 200 len: 14 microversion: 2.20 time: 0.080992 Oct 29 01:34:29.295327 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 434/861] 10.222.0.87 () {62 vars in 1318 bytes} [Fri Oct 29 01:34:29 2021] POST /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:34:29.543061 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-68eb7a3f-7f15-4d55-9ac4-14ef7dfbf4de tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:34:29.544256 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-68eb7a3f-7f15-4d55-9ac4-14ef7dfbf4de tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: ba08d2b5-ae9e-43db-b376-18011c8863f6] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:29.552192 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-68eb7a3f-7f15-4d55-9ac4-14ef7dfbf4de tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:29.552643 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-68eb7a3f-7f15-4d55-9ac4-14ef7dfbf4de tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:29.553411 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-68eb7a3f-7f15-4d55-9ac4-14ef7dfbf4de tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:29.553844 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-68eb7a3f-7f15-4d55-9ac4-14ef7dfbf4de tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:29.626206 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-68eb7a3f-7f15-4d55-9ac4-14ef7dfbf4de tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "POST /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6/action" status: 200 len: 14 microversion: 2.1 time: 0.086966 Oct 29 01:34:29.629502 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 428/862] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:34:29 2021] POST /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6/action => generated 14 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:34:30.307033 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-5762a67c-6353-4966-8744-0a4f642d7962 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:34:30.308272 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-5762a67c-6353-4966-8744-0a4f642d7962 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:30.316061 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-5762a67c-6353-4966-8744-0a4f642d7962 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:30.319118 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-5762a67c-6353-4966-8744-0a4f642d7962 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:30.319118 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-5762a67c-6353-4966-8744-0a4f642d7962 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:30.319118 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-5762a67c-6353-4966-8744-0a4f642d7962 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:30.410793 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-5762a67c-6353-4966-8744-0a4f642d7962 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "POST /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a/action" status: 200 len: 14 microversion: 2.20 time: 0.108177 Oct 29 01:34:30.411433 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 435/863] 10.222.0.87 () {62 vars in 1318 bytes} [Fri Oct 29 01:34:30 2021] POST /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a/action => generated 14 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:34:30.637535 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-31a87022-29ee-4a28-9e28-cd6b36905ef7 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:34:30.638529 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-31a87022-29ee-4a28-9e28-cd6b36905ef7 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: ba08d2b5-ae9e-43db-b376-18011c8863f6] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:30.645488 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-31a87022-29ee-4a28-9e28-cd6b36905ef7 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:30.645927 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-31a87022-29ee-4a28-9e28-cd6b36905ef7 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:30.646715 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-31a87022-29ee-4a28-9e28-cd6b36905ef7 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:30.647141 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-31a87022-29ee-4a28-9e28-cd6b36905ef7 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:30.713712 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-31a87022-29ee-4a28-9e28-cd6b36905ef7 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "POST /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6/action" status: 200 len: 14 microversion: 2.1 time: 0.079955 Oct 29 01:34:30.714544 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 429/864] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:34:30 2021] POST /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6/action => generated 14 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:34:31.423022 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-727a1202-2f1c-4923-acab-c9d0b902bf8c tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:34:31.424790 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-727a1202-2f1c-4923-acab-c9d0b902bf8c tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:31.432877 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-727a1202-2f1c-4923-acab-c9d0b902bf8c tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:31.433693 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-727a1202-2f1c-4923-acab-c9d0b902bf8c tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:31.434760 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-727a1202-2f1c-4923-acab-c9d0b902bf8c tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:31.435404 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-727a1202-2f1c-4923-acab-c9d0b902bf8c tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:31.511517 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-727a1202-2f1c-4923-acab-c9d0b902bf8c tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "POST /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a/action" status: 200 len: 14 microversion: 2.20 time: 0.093276 Oct 29 01:34:31.512386 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 436/865] 10.222.0.87 () {62 vars in 1318 bytes} [Fri Oct 29 01:34:31 2021] POST /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:34:31.725020 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-78ed3d44-67aa-4e4f-a8dc-6dc7d6aa47d3 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:34:31.726633 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-78ed3d44-67aa-4e4f-a8dc-6dc7d6aa47d3 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: ba08d2b5-ae9e-43db-b376-18011c8863f6] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:31.734188 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-78ed3d44-67aa-4e4f-a8dc-6dc7d6aa47d3 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:31.734838 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-78ed3d44-67aa-4e4f-a8dc-6dc7d6aa47d3 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:31.735826 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-78ed3d44-67aa-4e4f-a8dc-6dc7d6aa47d3 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:31.736418 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-78ed3d44-67aa-4e4f-a8dc-6dc7d6aa47d3 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:31.803786 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-78ed3d44-67aa-4e4f-a8dc-6dc7d6aa47d3 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "POST /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6/action" status: 200 len: 14 microversion: 2.1 time: 0.082604 Oct 29 01:34:31.804594 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 430/866] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:34:31 2021] POST /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6/action => generated 14 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:34:32.523560 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-7a10a707-ba49-4756-b13d-55f3240b3044 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:34:32.524751 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-7a10a707-ba49-4756-b13d-55f3240b3044 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:32.532018 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-7a10a707-ba49-4756-b13d-55f3240b3044 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:32.532553 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-7a10a707-ba49-4756-b13d-55f3240b3044 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:32.533334 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-7a10a707-ba49-4756-b13d-55f3240b3044 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:32.533760 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-7a10a707-ba49-4756-b13d-55f3240b3044 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:32.601930 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-7a10a707-ba49-4756-b13d-55f3240b3044 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "POST /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a/action" status: 200 len: 14 microversion: 2.20 time: 0.082328 Oct 29 01:34:32.603330 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 437/867] 10.222.0.87 () {62 vars in 1318 bytes} [Fri Oct 29 01:34:32 2021] POST /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a/action => generated 14 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:34:32.816003 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-1f78cabe-d17a-4a0a-81bf-2b2d2b8cac39 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:34:32.818304 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-1f78cabe-d17a-4a0a-81bf-2b2d2b8cac39 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: ba08d2b5-ae9e-43db-b376-18011c8863f6] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:32.830107 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-1f78cabe-d17a-4a0a-81bf-2b2d2b8cac39 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:32.831102 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-1f78cabe-d17a-4a0a-81bf-2b2d2b8cac39 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:32.833343 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-1f78cabe-d17a-4a0a-81bf-2b2d2b8cac39 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:32.834274 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-1f78cabe-d17a-4a0a-81bf-2b2d2b8cac39 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:32.912234 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-1f78cabe-d17a-4a0a-81bf-2b2d2b8cac39 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "POST /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6/action" status: 200 len: 14 microversion: 2.1 time: 0.100667 Oct 29 01:34:32.913185 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 431/868] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:34:32 2021] POST /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6/action => generated 14 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:34:33.613475 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-686d6754-b0ba-4eba-ba41-8cf6f12c0a1e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:34:33.614629 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-686d6754-b0ba-4eba-ba41-8cf6f12c0a1e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:33.621006 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-686d6754-b0ba-4eba-ba41-8cf6f12c0a1e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:33.621441 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-686d6754-b0ba-4eba-ba41-8cf6f12c0a1e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:33.622280 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-686d6754-b0ba-4eba-ba41-8cf6f12c0a1e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:33.622705 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-686d6754-b0ba-4eba-ba41-8cf6f12c0a1e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:33.699060 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-686d6754-b0ba-4eba-ba41-8cf6f12c0a1e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "POST /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a/action" status: 200 len: 14 microversion: 2.20 time: 0.089534 Oct 29 01:34:33.699791 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 438/869] 10.222.0.87 () {62 vars in 1318 bytes} [Fri Oct 29 01:34:33 2021] POST /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a/action => generated 14 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:34:33.924450 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-1fee23ad-591b-46d1-ba1e-13ac55101cce tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:34:33.926329 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-1fee23ad-591b-46d1-ba1e-13ac55101cce tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: ba08d2b5-ae9e-43db-b376-18011c8863f6] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:33.933545 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-1fee23ad-591b-46d1-ba1e-13ac55101cce tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:33.934002 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-1fee23ad-591b-46d1-ba1e-13ac55101cce tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:33.934767 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-1fee23ad-591b-46d1-ba1e-13ac55101cce tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:33.935197 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-1fee23ad-591b-46d1-ba1e-13ac55101cce tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:34.031610 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-1fee23ad-591b-46d1-ba1e-13ac55101cce tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "POST /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6/action" status: 200 len: 14 microversion: 2.1 time: 0.111745 Oct 29 01:34:34.032449 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 432/870] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:34:33 2021] POST /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6/action => generated 14 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:34:34.716078 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-3cb8b74d-0b8b-44d3-ab96-f0c64785dcfb tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:34:34.717643 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-3cb8b74d-0b8b-44d3-ab96-f0c64785dcfb tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:34.727322 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-3cb8b74d-0b8b-44d3-ab96-f0c64785dcfb tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:34.727810 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-3cb8b74d-0b8b-44d3-ab96-f0c64785dcfb tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:34.728584 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-3cb8b74d-0b8b-44d3-ab96-f0c64785dcfb tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:34.729002 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-3cb8b74d-0b8b-44d3-ab96-f0c64785dcfb tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:34.816764 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-3cb8b74d-0b8b-44d3-ab96-f0c64785dcfb tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "POST /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a/action" status: 200 len: 14 microversion: 2.20 time: 0.110011 Oct 29 01:34:34.817704 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 439/871] 10.222.0.87 () {62 vars in 1318 bytes} [Fri Oct 29 01:34:34 2021] POST /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a/action => generated 14 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:34:35.043223 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-6e4b46f3-dd94-47aa-a677-4faeb84b5267 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:34:35.045466 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-6e4b46f3-dd94-47aa-a677-4faeb84b5267 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: ba08d2b5-ae9e-43db-b376-18011c8863f6] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:35.052180 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-6e4b46f3-dd94-47aa-a677-4faeb84b5267 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:35.052440 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-6e4b46f3-dd94-47aa-a677-4faeb84b5267 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:35.053402 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-6e4b46f3-dd94-47aa-a677-4faeb84b5267 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:35.053833 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-6e4b46f3-dd94-47aa-a677-4faeb84b5267 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:35.121067 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-6e4b46f3-dd94-47aa-a677-4faeb84b5267 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "POST /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6/action" status: 200 len: 14 microversion: 2.1 time: 0.081813 Oct 29 01:34:35.125685 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 433/872] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:34:35 2021] POST /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6/action => generated 14 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:34:35.830743 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-5a3754d3-12d7-43b2-9886-f4aad6be03e3 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:34:35.832407 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-5a3754d3-12d7-43b2-9886-f4aad6be03e3 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:35.840693 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-5a3754d3-12d7-43b2-9886-f4aad6be03e3 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:35.844183 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-5a3754d3-12d7-43b2-9886-f4aad6be03e3 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:35.845742 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-5a3754d3-12d7-43b2-9886-f4aad6be03e3 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:35.846357 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-5a3754d3-12d7-43b2-9886-f4aad6be03e3 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:35.926399 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-5a3754d3-12d7-43b2-9886-f4aad6be03e3 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "POST /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a/action" status: 200 len: 14 microversion: 2.20 time: 0.102339 Oct 29 01:34:35.927395 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 440/873] 10.222.0.87 () {62 vars in 1318 bytes} [Fri Oct 29 01:34:35 2021] POST /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a/action => generated 14 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:34:36.133666 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-03680f0d-48d4-410b-bbf8-5968a6a47df2 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:34:36.134685 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-03680f0d-48d4-410b-bbf8-5968a6a47df2 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: ba08d2b5-ae9e-43db-b376-18011c8863f6] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:36.142346 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-03680f0d-48d4-410b-bbf8-5968a6a47df2 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:36.142786 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-03680f0d-48d4-410b-bbf8-5968a6a47df2 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:36.143545 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-03680f0d-48d4-410b-bbf8-5968a6a47df2 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:36.144093 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-03680f0d-48d4-410b-bbf8-5968a6a47df2 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:36.226481 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-03680f0d-48d4-410b-bbf8-5968a6a47df2 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "POST /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6/action" status: 200 len: 14 microversion: 2.1 time: 0.096823 Oct 29 01:34:36.230225 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 434/874] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:34:36 2021] POST /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6/action => generated 14 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:34:36.938678 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-6e647bb7-2fb7-46ec-bec7-4a3974b97342 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:34:36.939950 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-6e647bb7-2fb7-46ec-bec7-4a3974b97342 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:36.946683 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-6e647bb7-2fb7-46ec-bec7-4a3974b97342 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:36.947337 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-6e647bb7-2fb7-46ec-bec7-4a3974b97342 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:36.948137 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-6e647bb7-2fb7-46ec-bec7-4a3974b97342 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:36.948562 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-6e647bb7-2fb7-46ec-bec7-4a3974b97342 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:37.019715 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-6e647bb7-2fb7-46ec-bec7-4a3974b97342 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "POST /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a/action" status: 200 len: 14 microversion: 2.20 time: 0.085566 Oct 29 01:34:37.021517 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 441/875] 10.222.0.87 () {62 vars in 1318 bytes} [Fri Oct 29 01:34:36 2021] POST /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a/action => generated 14 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:34:37.239421 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-01bda61d-8345-4d0a-9fec-396d6f7affba tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:34:37.241255 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-01bda61d-8345-4d0a-9fec-396d6f7affba tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: ba08d2b5-ae9e-43db-b376-18011c8863f6] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:37.251308 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-01bda61d-8345-4d0a-9fec-396d6f7affba tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:37.251308 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-01bda61d-8345-4d0a-9fec-396d6f7affba tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:37.251308 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-01bda61d-8345-4d0a-9fec-396d6f7affba tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:37.251308 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-01bda61d-8345-4d0a-9fec-396d6f7affba tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:37.323879 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-01bda61d-8345-4d0a-9fec-396d6f7affba tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "POST /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6/action" status: 200 len: 14 microversion: 2.1 time: 0.089580 Oct 29 01:34:37.324676 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 435/876] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:34:37 2021] POST /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6/action => generated 14 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:34:38.034747 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-f65c6d38-018d-49c7-ba32-c806849e86c2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:34:38.041627 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-f65c6d38-018d-49c7-ba32-c806849e86c2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:38.043209 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-f65c6d38-018d-49c7-ba32-c806849e86c2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:38.043944 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-f65c6d38-018d-49c7-ba32-c806849e86c2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:38.045072 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-f65c6d38-018d-49c7-ba32-c806849e86c2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:38.045788 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-f65c6d38-018d-49c7-ba32-c806849e86c2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:38.146230 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-f65c6d38-018d-49c7-ba32-c806849e86c2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "POST /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a/action" status: 200 len: 2137 microversion: 2.20 time: 0.116451 Oct 29 01:34:38.148610 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 442/877] 10.222.0.87 () {62 vars in 1318 bytes} [Fri Oct 29 01:34:38 2021] POST /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a/action => generated 2137 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:34:38.337186 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-181a38bf-278a-4475-8f6b-eb6e1182b31b tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:34:38.339024 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-181a38bf-278a-4475-8f6b-eb6e1182b31b tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: ba08d2b5-ae9e-43db-b376-18011c8863f6] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:38.348918 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-181a38bf-278a-4475-8f6b-eb6e1182b31b tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:38.349559 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-181a38bf-278a-4475-8f6b-eb6e1182b31b tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:38.350352 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-181a38bf-278a-4475-8f6b-eb6e1182b31b tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:38.350775 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-181a38bf-278a-4475-8f6b-eb6e1182b31b tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:38.474462 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-181a38bf-278a-4475-8f6b-eb6e1182b31b tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "POST /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6/action" status: 200 len: 14 microversion: 2.1 time: 0.141480 Oct 29 01:34:38.475437 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 436/878] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:34:38 2021] POST /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6/action => generated 14 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:34:39.163926 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-88146638-2800-4175-822c-f6d450013549 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:34:39.166113 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-88146638-2800-4175-822c-f6d450013549 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:39.175381 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-88146638-2800-4175-822c-f6d450013549 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:39.176115 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-88146638-2800-4175-822c-f6d450013549 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:39.176892 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-88146638-2800-4175-822c-f6d450013549 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:39.177726 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-88146638-2800-4175-822c-f6d450013549 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:39.275144 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-88146638-2800-4175-822c-f6d450013549 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "POST /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a/action" status: 200 len: 10009 microversion: 2.20 time: 0.119710 Oct 29 01:34:39.276024 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 443/879] 10.222.0.87 () {62 vars in 1318 bytes} [Fri Oct 29 01:34:39 2021] POST /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a/action => generated 10009 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:34:39.488628 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-132f3e49-f2dc-4658-955b-769259b01f17 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:34:39.490300 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-132f3e49-f2dc-4658-955b-769259b01f17 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: ba08d2b5-ae9e-43db-b376-18011c8863f6] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:39.498344 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-132f3e49-f2dc-4658-955b-769259b01f17 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:39.498800 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-132f3e49-f2dc-4658-955b-769259b01f17 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:39.499810 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-132f3e49-f2dc-4658-955b-769259b01f17 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:39.500245 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-132f3e49-f2dc-4658-955b-769259b01f17 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:39.587927 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-132f3e49-f2dc-4658-955b-769259b01f17 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "POST /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6/action" status: 200 len: 14 microversion: 2.1 time: 0.103645 Oct 29 01:34:39.593520 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 437/880] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:34:39 2021] POST /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6/action => generated 14 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:34:40.288748 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-459bc7af-09e9-40cd-ade8-f27768614dd8 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:34:40.293015 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-459bc7af-09e9-40cd-ade8-f27768614dd8 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:40.297212 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-459bc7af-09e9-40cd-ade8-f27768614dd8 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:40.297671 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-459bc7af-09e9-40cd-ade8-f27768614dd8 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:40.298470 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-459bc7af-09e9-40cd-ade8-f27768614dd8 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:40.298890 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-459bc7af-09e9-40cd-ade8-f27768614dd8 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:40.410032 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-459bc7af-09e9-40cd-ade8-f27768614dd8 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "POST /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a/action" status: 200 len: 15064 microversion: 2.20 time: 0.125500 Oct 29 01:34:40.411175 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 444/881] 10.222.0.87 () {62 vars in 1318 bytes} [Fri Oct 29 01:34:40 2021] POST /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a/action => generated 15064 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:34:40.600766 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-e79cbe56-4a6f-49e9-a1ca-55dbe2317768 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:34:40.602368 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-e79cbe56-4a6f-49e9-a1ca-55dbe2317768 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: ba08d2b5-ae9e-43db-b376-18011c8863f6] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:40.611229 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-e79cbe56-4a6f-49e9-a1ca-55dbe2317768 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:40.611701 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-e79cbe56-4a6f-49e9-a1ca-55dbe2317768 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:40.612455 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-e79cbe56-4a6f-49e9-a1ca-55dbe2317768 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:40.612900 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-e79cbe56-4a6f-49e9-a1ca-55dbe2317768 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:40.719854 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-e79cbe56-4a6f-49e9-a1ca-55dbe2317768 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "POST /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6/action" status: 200 len: 9542 microversion: 2.1 time: 0.122885 Oct 29 01:34:40.721273 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 438/882] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:34:40 2021] POST /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6/action => generated 9542 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:34:41.424068 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-3fda5625-edf1-42db-a09f-e038eaeb6e8a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:34:41.425779 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-3fda5625-edf1-42db-a09f-e038eaeb6e8a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:41.433231 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-3fda5625-edf1-42db-a09f-e038eaeb6e8a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:41.433795 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-3fda5625-edf1-42db-a09f-e038eaeb6e8a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:41.434727 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-3fda5625-edf1-42db-a09f-e038eaeb6e8a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:41.435255 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-3fda5625-edf1-42db-a09f-e038eaeb6e8a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:41.526020 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-3fda5625-edf1-42db-a09f-e038eaeb6e8a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "POST /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a/action" status: 200 len: 17861 microversion: 2.20 time: 0.107128 Oct 29 01:34:41.527171 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 445/883] 10.222.0.87 () {62 vars in 1318 bytes} [Fri Oct 29 01:34:41 2021] POST /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a/action => generated 17861 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:34:41.731666 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-aeadb094-448c-4366-aaa5-b99664d63de4 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:34:41.732688 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-aeadb094-448c-4366-aaa5-b99664d63de4 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: ba08d2b5-ae9e-43db-b376-18011c8863f6] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:41.739541 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-aeadb094-448c-4366-aaa5-b99664d63de4 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:41.740032 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-aeadb094-448c-4366-aaa5-b99664d63de4 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:41.740807 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-aeadb094-448c-4366-aaa5-b99664d63de4 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:41.741241 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-aeadb094-448c-4366-aaa5-b99664d63de4 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:41.825520 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-aeadb094-448c-4366-aaa5-b99664d63de4 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "POST /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6/action" status: 200 len: 15025 microversion: 2.1 time: 0.097573 Oct 29 01:34:41.831307 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 439/884] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:34:41 2021] POST /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6/action => generated 15025 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 01:34:42.539249 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-c4e26348-7ef2-4577-b01a-33318cbae30e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:34:42.540272 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-c4e26348-7ef2-4577-b01a-33318cbae30e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:42.552367 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c4e26348-7ef2-4577-b01a-33318cbae30e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:42.555087 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c4e26348-7ef2-4577-b01a-33318cbae30e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:42.557046 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c4e26348-7ef2-4577-b01a-33318cbae30e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:42.558650 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c4e26348-7ef2-4577-b01a-33318cbae30e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:42.663050 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-c4e26348-7ef2-4577-b01a-33318cbae30e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "POST /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a/action" status: 200 len: 19342 microversion: 2.20 time: 0.127635 Oct 29 01:34:42.663703 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 446/885] 10.222.0.87 () {62 vars in 1318 bytes} [Fri Oct 29 01:34:42 2021] POST /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a/action => generated 19342 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:34:42.840638 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-2fff1de9-590f-4f46-a54a-1758fb919b44 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:34:42.853593 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-2fff1de9-590f-4f46-a54a-1758fb919b44 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: ba08d2b5-ae9e-43db-b376-18011c8863f6] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:42.879987 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-2fff1de9-590f-4f46-a54a-1758fb919b44 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:42.880509 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-2fff1de9-590f-4f46-a54a-1758fb919b44 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:42.881543 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-2fff1de9-590f-4f46-a54a-1758fb919b44 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:42.882150 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-2fff1de9-590f-4f46-a54a-1758fb919b44 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:42.982840 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-2fff1de9-590f-4f46-a54a-1758fb919b44 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "POST /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6/action" status: 200 len: 18155 microversion: 2.1 time: 0.147317 Oct 29 01:34:42.988686 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 440/886] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:34:42 2021] POST /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6/action => generated 18155 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:34:43.678191 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-6eb91158-63dc-4832-bd03-170342b89e9b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:34:43.678191 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-6eb91158-63dc-4832-bd03-170342b89e9b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:43.684230 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-6eb91158-63dc-4832-bd03-170342b89e9b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:43.684664 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-6eb91158-63dc-4832-bd03-170342b89e9b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:43.686035 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-6eb91158-63dc-4832-bd03-170342b89e9b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:43.686469 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-6eb91158-63dc-4832-bd03-170342b89e9b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:43.785291 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-6eb91158-63dc-4832-bd03-170342b89e9b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "POST /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a/action" status: 200 len: 21513 microversion: 2.20 time: 0.113578 Oct 29 01:34:43.790290 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 447/887] 10.222.0.87 () {62 vars in 1318 bytes} [Fri Oct 29 01:34:43 2021] POST /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a/action => generated 21513 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 29 01:34:43.999673 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-eeb51294-4ad7-47b6-81a3-f60db79565ec tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:34:44.001389 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-eeb51294-4ad7-47b6-81a3-f60db79565ec tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: ba08d2b5-ae9e-43db-b376-18011c8863f6] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:44.008456 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-eeb51294-4ad7-47b6-81a3-f60db79565ec tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:44.009134 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-eeb51294-4ad7-47b6-81a3-f60db79565ec tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:44.010105 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-eeb51294-4ad7-47b6-81a3-f60db79565ec tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:44.010714 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-eeb51294-4ad7-47b6-81a3-f60db79565ec tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:44.116814 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-eeb51294-4ad7-47b6-81a3-f60db79565ec tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "POST /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6/action" status: 200 len: 19342 microversion: 2.1 time: 0.121709 Oct 29 01:34:44.121279 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 441/888] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:34:43 2021] POST /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6/action => generated 19342 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:34:44.806584 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-47971f92-7650-49c0-910c-a8825acf0ee5 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:34:44.808720 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-47971f92-7650-49c0-910c-a8825acf0ee5 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:44.816909 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-47971f92-7650-49c0-910c-a8825acf0ee5 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:44.817655 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-47971f92-7650-49c0-910c-a8825acf0ee5 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:44.818665 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-47971f92-7650-49c0-910c-a8825acf0ee5 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:44.819315 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-47971f92-7650-49c0-910c-a8825acf0ee5 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:44.909332 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-47971f92-7650-49c0-910c-a8825acf0ee5 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "POST /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a/action" status: 200 len: 22975 microversion: 2.20 time: 0.110282 Oct 29 01:34:44.910300 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 448/889] 10.222.0.87 () {62 vars in 1318 bytes} [Fri Oct 29 01:34:44 2021] POST /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a/action => generated 22975 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:34:45.130272 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-a9ed7de5-97c0-4e03-8ccf-3d8e91cd511d tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:34:45.131280 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-a9ed7de5-97c0-4e03-8ccf-3d8e91cd511d tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: ba08d2b5-ae9e-43db-b376-18011c8863f6] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:45.138431 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-a9ed7de5-97c0-4e03-8ccf-3d8e91cd511d tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:45.139258 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-a9ed7de5-97c0-4e03-8ccf-3d8e91cd511d tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:45.140251 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-a9ed7de5-97c0-4e03-8ccf-3d8e91cd511d tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:45.140976 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-a9ed7de5-97c0-4e03-8ccf-3d8e91cd511d tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:45.227470 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-a9ed7de5-97c0-4e03-8ccf-3d8e91cd511d tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "POST /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6/action" status: 200 len: 21972 microversion: 2.1 time: 0.101169 Oct 29 01:34:45.230718 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 442/890] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:34:45 2021] POST /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6/action => generated 21972 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:34:45.923166 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-19e0aaff-107f-433d-a014-5ff62a94e723 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:34:45.924099 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-19e0aaff-107f-433d-a014-5ff62a94e723 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:45.933621 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-19e0aaff-107f-433d-a014-5ff62a94e723 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:45.934059 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-19e0aaff-107f-433d-a014-5ff62a94e723 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:45.934826 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-19e0aaff-107f-433d-a014-5ff62a94e723 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:45.935300 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-19e0aaff-107f-433d-a014-5ff62a94e723 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:46.027128 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-19e0aaff-107f-433d-a014-5ff62a94e723 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "POST /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a/action" status: 200 len: 23798 microversion: 2.20 time: 0.108401 Oct 29 01:34:46.028369 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 449/891] 10.222.0.87 () {62 vars in 1318 bytes} [Fri Oct 29 01:34:45 2021] POST /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a/action => generated 23798 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:34:46.248258 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-6d0a3bdd-b410-477f-a8a3-e59a9b4bbdf6 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:34:46.251441 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-6d0a3bdd-b410-477f-a8a3-e59a9b4bbdf6 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: ba08d2b5-ae9e-43db-b376-18011c8863f6] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:46.264499 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-6d0a3bdd-b410-477f-a8a3-e59a9b4bbdf6 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:46.265796 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-6d0a3bdd-b410-477f-a8a3-e59a9b4bbdf6 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:46.267603 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-6d0a3bdd-b410-477f-a8a3-e59a9b4bbdf6 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:46.268649 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-6d0a3bdd-b410-477f-a8a3-e59a9b4bbdf6 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:46.363592 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-6d0a3bdd-b410-477f-a8a3-e59a9b4bbdf6 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "POST /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6/action" status: 200 len: 23235 microversion: 2.1 time: 0.123882 Oct 29 01:34:46.364303 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 443/892] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:34:46 2021] POST /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6/action => generated 23235 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:34:47.050632 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-dc6aa180-b5b9-4b23-92c6-20459ec9b317 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:34:47.051789 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-dc6aa180-b5b9-4b23-92c6-20459ec9b317 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:47.058626 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-dc6aa180-b5b9-4b23-92c6-20459ec9b317 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:47.059070 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-dc6aa180-b5b9-4b23-92c6-20459ec9b317 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:47.060578 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-dc6aa180-b5b9-4b23-92c6-20459ec9b317 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:47.060578 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-dc6aa180-b5b9-4b23-92c6-20459ec9b317 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:47.151859 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-dc6aa180-b5b9-4b23-92c6-20459ec9b317 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "POST /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a/action" status: 200 len: 25102 microversion: 2.20 time: 0.116258 Oct 29 01:34:47.152734 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 450/893] 10.222.0.87 () {62 vars in 1318 bytes} [Fri Oct 29 01:34:47 2021] POST /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a/action => generated 25102 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:34:47.376939 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-83c36f15-0e60-43f5-95a3-4234f31d7d93 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:34:47.378072 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-83c36f15-0e60-43f5-95a3-4234f31d7d93 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: ba08d2b5-ae9e-43db-b376-18011c8863f6] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:47.387661 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-83c36f15-0e60-43f5-95a3-4234f31d7d93 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:47.389949 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-83c36f15-0e60-43f5-95a3-4234f31d7d93 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:47.390730 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-83c36f15-0e60-43f5-95a3-4234f31d7d93 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:47.391157 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-83c36f15-0e60-43f5-95a3-4234f31d7d93 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:47.491458 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-83c36f15-0e60-43f5-95a3-4234f31d7d93 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "POST /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6/action" status: 200 len: 24579 microversion: 2.1 time: 0.118843 Oct 29 01:34:47.492173 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 444/894] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:34:47 2021] POST /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6/action => generated 24579 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:34:48.165973 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-c3cc19be-9996-4821-87fe-ba571f35936d tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:34:48.168050 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-c3cc19be-9996-4821-87fe-ba571f35936d tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:48.178890 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c3cc19be-9996-4821-87fe-ba571f35936d tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:48.179330 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c3cc19be-9996-4821-87fe-ba571f35936d tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:48.180325 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c3cc19be-9996-4821-87fe-ba571f35936d tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:48.180751 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c3cc19be-9996-4821-87fe-ba571f35936d tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:48.503433 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-ffc27644-de90-4bcb-ba89-f92570afe274 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:34:48.505235 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-ffc27644-de90-4bcb-ba89-f92570afe274 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: ba08d2b5-ae9e-43db-b376-18011c8863f6] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:48.512446 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-ffc27644-de90-4bcb-ba89-f92570afe274 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:48.513800 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-ffc27644-de90-4bcb-ba89-f92570afe274 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:48.514563 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-ffc27644-de90-4bcb-ba89-f92570afe274 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:48.515178 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-ffc27644-de90-4bcb-ba89-f92570afe274 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:50.924265 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-c3cc19be-9996-4821-87fe-ba571f35936d tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "POST /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a/action" status: 200 len: 27582 microversion: 2.20 time: 2.763270 Oct 29 01:34:50.928526 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 451/895] 10.222.0.87 () {62 vars in 1318 bytes} [Fri Oct 29 01:34:48 2021] POST /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a/action => generated 27582 bytes in 2766 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:34:50.961351 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-ffc27644-de90-4bcb-ba89-f92570afe274 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "POST /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6/action" status: 200 len: 27117 microversion: 2.1 time: 2.461830 Oct 29 01:34:50.962608 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 445/896] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:34:48 2021] POST /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6/action => generated 27117 bytes in 2465 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 01:34:51.937449 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-e9ec873c-6781-46d8-a6e1-35c6d0deb865 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:34:51.941293 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-e9ec873c-6781-46d8-a6e1-35c6d0deb865 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:51.949602 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-e9ec873c-6781-46d8-a6e1-35c6d0deb865 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:51.955354 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-e9ec873c-6781-46d8-a6e1-35c6d0deb865 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:51.955354 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-e9ec873c-6781-46d8-a6e1-35c6d0deb865 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:51.955354 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-e9ec873c-6781-46d8-a6e1-35c6d0deb865 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:51.974119 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-e0bae34f-e1e0-4df0-b063-bf2cd69b8af7 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:34:51.976068 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-e0bae34f-e1e0-4df0-b063-bf2cd69b8af7 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: ba08d2b5-ae9e-43db-b376-18011c8863f6] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:51.990329 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-e0bae34f-e1e0-4df0-b063-bf2cd69b8af7 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:51.990781 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-e0bae34f-e1e0-4df0-b063-bf2cd69b8af7 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:51.991605 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-e0bae34f-e1e0-4df0-b063-bf2cd69b8af7 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:51.992100 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-e0bae34f-e1e0-4df0-b063-bf2cd69b8af7 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:52.066510 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-e9ec873c-6781-46d8-a6e1-35c6d0deb865 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "POST /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a/action" status: 200 len: 27886 microversion: 2.20 time: 0.133493 Oct 29 01:34:52.068929 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 452/897] 10.222.0.87 () {62 vars in 1318 bytes} [Fri Oct 29 01:34:51 2021] POST /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a/action => generated 27886 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:34:52.106818 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-e0bae34f-e1e0-4df0-b063-bf2cd69b8af7 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "POST /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6/action" status: 200 len: 27505 microversion: 2.1 time: 0.136472 Oct 29 01:34:52.108612 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 446/898] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:34:51 2021] POST /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6/action => generated 27505 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:34:53.081251 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-a083ed32-eb2f-4d83-ac36-472c161039ff tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:34:53.082951 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-a083ed32-eb2f-4d83-ac36-472c161039ff tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:53.090517 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a083ed32-eb2f-4d83-ac36-472c161039ff tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:53.091273 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a083ed32-eb2f-4d83-ac36-472c161039ff tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:53.117492 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a083ed32-eb2f-4d83-ac36-472c161039ff tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:53.117492 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a083ed32-eb2f-4d83-ac36-472c161039ff tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:53.119215 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-aec752ae-e59b-49a2-9d61-890d63db0672 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:34:53.120238 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-aec752ae-e59b-49a2-9d61-890d63db0672 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: ba08d2b5-ae9e-43db-b376-18011c8863f6] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:53.128712 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-aec752ae-e59b-49a2-9d61-890d63db0672 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:53.129155 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-aec752ae-e59b-49a2-9d61-890d63db0672 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:53.129943 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-aec752ae-e59b-49a2-9d61-890d63db0672 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:53.130444 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-aec752ae-e59b-49a2-9d61-890d63db0672 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:53.199958 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-a083ed32-eb2f-4d83-ac36-472c161039ff tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "POST /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a/action" status: 200 len: 28196 microversion: 2.20 time: 0.124384 Oct 29 01:34:53.202245 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 453/899] 10.222.0.87 () {62 vars in 1318 bytes} [Fri Oct 29 01:34:53 2021] POST /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a/action => generated 28196 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 29 01:34:53.243457 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-aec752ae-e59b-49a2-9d61-890d63db0672 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "POST /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6/action" status: 200 len: 27992 microversion: 2.1 time: 0.128196 Oct 29 01:34:53.244810 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 447/900] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:34:53 2021] POST /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6/action => generated 27992 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:34:54.213619 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-dcf1e4cd-3a20-4613-9e91-f46580bebd18 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:34:54.214543 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-dcf1e4cd-3a20-4613-9e91-f46580bebd18 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:54.221472 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-dcf1e4cd-3a20-4613-9e91-f46580bebd18 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:54.225555 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-dcf1e4cd-3a20-4613-9e91-f46580bebd18 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:54.225555 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-dcf1e4cd-3a20-4613-9e91-f46580bebd18 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:54.225555 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-dcf1e4cd-3a20-4613-9e91-f46580bebd18 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:54.255870 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-6c41d940-1522-4d6d-ab55-39facec4c072 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:34:54.256897 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-6c41d940-1522-4d6d-ab55-39facec4c072 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: ba08d2b5-ae9e-43db-b376-18011c8863f6] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:54.264110 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-6c41d940-1522-4d6d-ab55-39facec4c072 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:54.264563 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-6c41d940-1522-4d6d-ab55-39facec4c072 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:54.265345 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-6c41d940-1522-4d6d-ab55-39facec4c072 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:54.265778 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-6c41d940-1522-4d6d-ab55-39facec4c072 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:54.292790 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-dcf1e4cd-3a20-4613-9e91-f46580bebd18 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "POST /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a/action" status: 200 len: 28196 microversion: 2.20 time: 0.083335 Oct 29 01:34:54.293473 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 454/901] 10.222.0.87 () {62 vars in 1318 bytes} [Fri Oct 29 01:34:54 2021] POST /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a/action => generated 28196 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:34:54.349845 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-6c41d940-1522-4d6d-ab55-39facec4c072 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "POST /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6/action" status: 200 len: 28176 microversion: 2.1 time: 0.098009 Oct 29 01:34:54.350494 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 448/902] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:34:54 2021] POST /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6/action => generated 28176 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:34:54.614245 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-c731b1f6-8c3a-4dfb-ae86-7769810c7e49 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Action: 'create', calling method: .version_select at 0x7ff62c0a3dc0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1789899737"}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:34:54.634084 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.quota [None req-c731b1f6-8c3a-4dfb-ae86-7769810c7e49 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Getting quotas for project 700a9aa6afdf4de6b64d375544d7eb88. Resources: {'key_pairs'} {{(pid=116378) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 01:34:54.639315 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.quota [None req-c731b1f6-8c3a-4dfb-ae86-7769810c7e49 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Getting quotas for user e1147a77b5da48f9a75cefa0ab0e6b87 and project 700a9aa6afdf4de6b64d375544d7eb88. Resources: {'key_pairs'} {{(pid=116378) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 01:34:55.003808 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.quota [None req-c731b1f6-8c3a-4dfb-ae86-7769810c7e49 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Getting quotas for project 700a9aa6afdf4de6b64d375544d7eb88. Resources: {'key_pairs'} {{(pid=116378) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 01:34:55.007385 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.quota [None req-c731b1f6-8c3a-4dfb-ae86-7769810c7e49 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Getting quotas for user e1147a77b5da48f9a75cefa0ab0e6b87 and project 700a9aa6afdf4de6b64d375544d7eb88. Resources: {'key_pairs'} {{(pid=116378) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 01:34:55.020110 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-c731b1f6-8c3a-4dfb-ae86-7769810c7e49 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.410412 Oct 29 01:34:55.023616 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 455/903] 10.222.0.87 () {60 vars in 1157 bytes} [Fri Oct 29 01:34:54 2021] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:34:55.119510 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-39031876-1c82-4afc-8367-93912cd18527 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-708493097", "imageRef": "be7963aa-ab98-408a-b625-44494f1a1035", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1789899737", "networks": [{"uuid": "f19f3101-bbb3-4742-8a56-446cb8123c94"}]}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:34:55.174947 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.network.neutron [None req-39031876-1c82-4afc-8367-93912cd18527 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] validate_networks() for [('f19f3101-bbb3-4742-8a56-446cb8123c94', None, None, None, None, None)] {{(pid=116379) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 29 01:34:55.305654 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-4dc67190-e5f8-4c98-ad1d-4f6c619a16e8 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:34:55.306770 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-4dc67190-e5f8-4c98-ad1d-4f6c619a16e8 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:55.313760 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4dc67190-e5f8-4c98-ad1d-4f6c619a16e8 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:55.314202 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4dc67190-e5f8-4c98-ad1d-4f6c619a16e8 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:55.314974 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4dc67190-e5f8-4c98-ad1d-4f6c619a16e8 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:55.315411 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4dc67190-e5f8-4c98-ad1d-4f6c619a16e8 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:55.409494 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-4dc67190-e5f8-4c98-ad1d-4f6c619a16e8 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "POST /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a/action" status: 200 len: 28438 microversion: 2.20 time: 0.107972 Oct 29 01:34:55.410536 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 456/904] 10.222.0.87 () {62 vars in 1318 bytes} [Fri Oct 29 01:34:55 2021] POST /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a/action => generated 28438 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:34:55.415678 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-eed03992-8771-4e7d-85ba-7ee999b1e267 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:34:55.416927 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-eed03992-8771-4e7d-85ba-7ee999b1e267 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: ba08d2b5-ae9e-43db-b376-18011c8863f6] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:55.424974 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-eed03992-8771-4e7d-85ba-7ee999b1e267 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:55.425684 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-eed03992-8771-4e7d-85ba-7ee999b1e267 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:55.426522 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-eed03992-8771-4e7d-85ba-7ee999b1e267 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:55.427157 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-eed03992-8771-4e7d-85ba-7ee999b1e267 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:55.516623 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-eed03992-8771-4e7d-85ba-7ee999b1e267 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "POST /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6/action" status: 200 len: 28303 microversion: 2.1 time: 0.104493 Oct 29 01:34:55.520466 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 457/905] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:34:55 2021] POST /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6/action => generated 28303 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:34:55.616884 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.virt.hardware [None req-39031876-1c82-4afc-8367-93912cd18527 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Flavor limits 0:0:0 {{(pid=116379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:34:55.617408 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.virt.hardware [None req-39031876-1c82-4afc-8367-93912cd18527 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Image limits 0:0:0 {{(pid=116379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:34:55.617752 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.virt.hardware [None req-39031876-1c82-4afc-8367-93912cd18527 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Flavor pref 0:0:0 {{(pid=116379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:34:55.618153 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.virt.hardware [None req-39031876-1c82-4afc-8367-93912cd18527 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Image pref 0:0:0 {{(pid=116379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:34:55.618556 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.virt.hardware [None req-39031876-1c82-4afc-8367-93912cd18527 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:34:55.627677 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-39031876-1c82-4afc-8367-93912cd18527 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:55.628148 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-39031876-1c82-4afc-8367-93912cd18527 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:55.628964 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-39031876-1c82-4afc-8367-93912cd18527 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:55.629389 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-39031876-1c82-4afc-8367-93912cd18527 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:55.651640 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.quota [None req-39031876-1c82-4afc-8367-93912cd18527 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Getting quotas for project 700a9aa6afdf4de6b64d375544d7eb88. Resources: {'instances', 'cores', 'ram'} {{(pid=116379) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 01:34:55.656953 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.quota [None req-39031876-1c82-4afc-8367-93912cd18527 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Getting quotas for user e1147a77b5da48f9a75cefa0ab0e6b87 and project 700a9aa6afdf4de6b64d375544d7eb88. Resources: {'instances', 'cores', 'ram'} {{(pid=116379) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 01:34:55.668404 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-39031876-1c82-4afc-8367-93912cd18527 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Going to run 1 instances... {{(pid=116379) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 29 01:34:55.671106 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-39031876-1c82-4afc-8367-93912cd18527 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] [instance: 1faefe62-60e7-43c3-bf58-686598242ea3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='be7963aa-ab98-408a-b625-44494f1a1035',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116379) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 29 01:34:55.963491 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-39031876-1c82-4afc-8367-93912cd18527 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.848141 Oct 29 01:34:55.964092 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 449/906] 10.222.0.87 () {60 vars in 1146 bytes} [Fri Oct 29 01:34:55 2021] POST /compute/v2.1/servers => generated 380 bytes in 850 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:34:55.974320 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-209a8d40-1640-4f74-8f88-dbef7b13ba4b tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:55.975117 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-209a8d40-1640-4f74-8f88-dbef7b13ba4b tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] [instance: 1faefe62-60e7-43c3-bf58-686598242ea3] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:56.053257 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-209a8d40-1640-4f74-8f88-dbef7b13ba4b tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1147a77b5da48f9a75cefa0ab0e6b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700a9aa6afdf4de6b64d375544d7eb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:56.063560 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-209a8d40-1640-4f74-8f88-dbef7b13ba4b tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] 10.222.0.87 "GET /compute/v2.1/servers/1faefe62-60e7-43c3-bf58-686598242ea3" status: 200 len: 1258 microversion: 2.1 time: 0.092593 Oct 29 01:34:56.076969 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 458/907] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:34:55 2021] GET /compute/v2.1/servers/1faefe62-60e7-43c3-bf58-686598242ea3 => generated 1258 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:34:56.422999 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-dd30479c-26ef-45ca-a375-5c567c4bbb97 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:34:56.423668 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-dd30479c-26ef-45ca-a375-5c567c4bbb97 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:56.432249 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-dd30479c-26ef-45ca-a375-5c567c4bbb97 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:56.432693 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-dd30479c-26ef-45ca-a375-5c567c4bbb97 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:56.433457 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-dd30479c-26ef-45ca-a375-5c567c4bbb97 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:56.433887 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-dd30479c-26ef-45ca-a375-5c567c4bbb97 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:56.521573 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-dd30479c-26ef-45ca-a375-5c567c4bbb97 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "POST /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a/action" status: 200 len: 28487 microversion: 2.20 time: 0.103489 Oct 29 01:34:56.526008 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 450/908] 10.222.0.87 () {62 vars in 1318 bytes} [Fri Oct 29 01:34:56 2021] POST /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a/action => generated 28487 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:34:56.532019 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-fa12a784-ffec-4f99-be28-31fde52f7495 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:34:56.533090 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-fa12a784-ffec-4f99-be28-31fde52f7495 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: ba08d2b5-ae9e-43db-b376-18011c8863f6] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:56.540096 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-fa12a784-ffec-4f99-be28-31fde52f7495 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:56.546457 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-fa12a784-ffec-4f99-be28-31fde52f7495 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:56.546457 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-fa12a784-ffec-4f99-be28-31fde52f7495 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:56.546457 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-fa12a784-ffec-4f99-be28-31fde52f7495 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:56.625718 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-fa12a784-ffec-4f99-be28-31fde52f7495 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "POST /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6/action" status: 200 len: 28467 microversion: 2.1 time: 0.097791 Oct 29 01:34:56.626594 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 459/909] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:34:56 2021] POST /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6/action => generated 28467 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:34:57.085081 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-88ecc4de-9c99-4264-85df-60aa275da215 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:57.085807 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-88ecc4de-9c99-4264-85df-60aa275da215 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] [instance: 1faefe62-60e7-43c3-bf58-686598242ea3] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:57.141787 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-88ecc4de-9c99-4264-85df-60aa275da215 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1147a77b5da48f9a75cefa0ab0e6b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700a9aa6afdf4de6b64d375544d7eb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:57.148651 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-88ecc4de-9c99-4264-85df-60aa275da215 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] 10.222.0.87 "GET /compute/v2.1/servers/1faefe62-60e7-43c3-bf58-686598242ea3" status: 200 len: 1258 microversion: 2.1 time: 0.067654 Oct 29 01:34:57.149340 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 451/910] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:34:57 2021] GET /compute/v2.1/servers/1faefe62-60e7-43c3-bf58-686598242ea3 => generated 1258 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:34:57.533899 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-ec057047-7d9d-4cec-9f9f-234be23bfc9c tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:34:57.534881 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-ec057047-7d9d-4cec-9f9f-234be23bfc9c tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:57.541755 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ec057047-7d9d-4cec-9f9f-234be23bfc9c tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:57.542191 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ec057047-7d9d-4cec-9f9f-234be23bfc9c tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:57.542946 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ec057047-7d9d-4cec-9f9f-234be23bfc9c tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:57.543370 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ec057047-7d9d-4cec-9f9f-234be23bfc9c tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:57.625034 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-ec057047-7d9d-4cec-9f9f-234be23bfc9c tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "POST /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a/action" status: 200 len: 28655 microversion: 2.20 time: 0.094629 Oct 29 01:34:57.625708 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 460/911] 10.222.0.87 () {62 vars in 1318 bytes} [Fri Oct 29 01:34:57 2021] POST /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a/action => generated 28655 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:34:57.637671 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-e4f20fc4-4561-4f0e-b8bc-d9e9d4395d42 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:34:57.638578 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-e4f20fc4-4561-4f0e-b8bc-d9e9d4395d42 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: ba08d2b5-ae9e-43db-b376-18011c8863f6] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:57.645630 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-e4f20fc4-4561-4f0e-b8bc-d9e9d4395d42 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:57.646075 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-e4f20fc4-4561-4f0e-b8bc-d9e9d4395d42 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:57.646838 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-e4f20fc4-4561-4f0e-b8bc-d9e9d4395d42 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:57.647261 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-e4f20fc4-4561-4f0e-b8bc-d9e9d4395d42 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:57.729161 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-e4f20fc4-4561-4f0e-b8bc-d9e9d4395d42 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "POST /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6/action" status: 200 len: 28635 microversion: 2.1 time: 0.095110 Oct 29 01:34:57.729710 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 452/912] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:34:57 2021] POST /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6/action => generated 28635 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:34:58.167457 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-0464b649-6823-48a7-a16d-ab3602a8fdc8 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:58.168416 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-0464b649-6823-48a7-a16d-ab3602a8fdc8 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] [instance: 1faefe62-60e7-43c3-bf58-686598242ea3] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:58.176839 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-0464b649-6823-48a7-a16d-ab3602a8fdc8 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:58.177292 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-0464b649-6823-48a7-a16d-ab3602a8fdc8 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:58.178148 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-0464b649-6823-48a7-a16d-ab3602a8fdc8 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:58.178587 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-0464b649-6823-48a7-a16d-ab3602a8fdc8 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:58.247067 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-0464b649-6823-48a7-a16d-ab3602a8fdc8 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1147a77b5da48f9a75cefa0ab0e6b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700a9aa6afdf4de6b64d375544d7eb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:58.255082 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-0464b649-6823-48a7-a16d-ab3602a8fdc8 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] 10.222.0.87 "GET /compute/v2.1/servers/1faefe62-60e7-43c3-bf58-686598242ea3" status: 200 len: 1262 microversion: 2.1 time: 0.092100 Oct 29 01:34:58.255643 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 461/913] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:34:58 2021] GET /compute/v2.1/servers/1faefe62-60e7-43c3-bf58-686598242ea3 => generated 1262 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:34:58.637504 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-c227a268-c6d2-4946-a7f7-989379dcc6ac tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:34:58.638736 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-c227a268-c6d2-4946-a7f7-989379dcc6ac tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:58.646450 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-c227a268-c6d2-4946-a7f7-989379dcc6ac tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:58.650086 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-c227a268-c6d2-4946-a7f7-989379dcc6ac tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:58.650086 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-c227a268-c6d2-4946-a7f7-989379dcc6ac tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:58.650086 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-c227a268-c6d2-4946-a7f7-989379dcc6ac tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:58.720311 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-c227a268-c6d2-4946-a7f7-989379dcc6ac tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "POST /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a/action" status: 200 len: 28655 microversion: 2.20 time: 0.086654 Oct 29 01:34:58.720882 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 453/914] 10.222.0.87 () {62 vars in 1318 bytes} [Fri Oct 29 01:34:58 2021] POST /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a/action => generated 28655 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:34:58.740486 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-0e092b51-ac5a-47d6-90bc-89747054c5f3 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:34:58.741400 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-0e092b51-ac5a-47d6-90bc-89747054c5f3 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: ba08d2b5-ae9e-43db-b376-18011c8863f6] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:58.747760 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-0e092b51-ac5a-47d6-90bc-89747054c5f3 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:58.748116 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-0e092b51-ac5a-47d6-90bc-89747054c5f3 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:58.748872 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-0e092b51-ac5a-47d6-90bc-89747054c5f3 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:58.749301 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-0e092b51-ac5a-47d6-90bc-89747054c5f3 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:58.818697 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-0e092b51-ac5a-47d6-90bc-89747054c5f3 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "POST /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6/action" status: 200 len: 28635 microversion: 2.1 time: 0.081623 Oct 29 01:34:58.819349 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 462/915] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:34:58 2021] POST /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6/action => generated 28635 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:34:59.272188 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-737f1eda-33d6-46f6-a904-a6e3ebb80ce3 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:34:59.273190 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-737f1eda-33d6-46f6-a904-a6e3ebb80ce3 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] [instance: 1faefe62-60e7-43c3-bf58-686598242ea3] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:59.281641 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-737f1eda-33d6-46f6-a904-a6e3ebb80ce3 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:59.282180 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-737f1eda-33d6-46f6-a904-a6e3ebb80ce3 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:59.283094 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-737f1eda-33d6-46f6-a904-a6e3ebb80ce3 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:59.283561 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-737f1eda-33d6-46f6-a904-a6e3ebb80ce3 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:59.345810 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-737f1eda-33d6-46f6-a904-a6e3ebb80ce3 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1147a77b5da48f9a75cefa0ab0e6b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700a9aa6afdf4de6b64d375544d7eb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:34:59.352969 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-737f1eda-33d6-46f6-a904-a6e3ebb80ce3 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] 10.222.0.87 "GET /compute/v2.1/servers/1faefe62-60e7-43c3-bf58-686598242ea3" status: 200 len: 1310 microversion: 2.1 time: 0.084963 Oct 29 01:34:59.353528 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 454/916] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:34:59 2021] GET /compute/v2.1/servers/1faefe62-60e7-43c3-bf58-686598242ea3 => generated 1310 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:34:59.732268 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-67a8b72e-9250-4424-ae2b-739a217b8d81 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:34:59.733168 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-67a8b72e-9250-4424-ae2b-739a217b8d81 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:59.740696 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-67a8b72e-9250-4424-ae2b-739a217b8d81 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:59.741359 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-67a8b72e-9250-4424-ae2b-739a217b8d81 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:59.741861 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-67a8b72e-9250-4424-ae2b-739a217b8d81 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:59.742289 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-67a8b72e-9250-4424-ae2b-739a217b8d81 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:59.821172 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-67a8b72e-9250-4424-ae2b-739a217b8d81 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "POST /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a/action" status: 200 len: 28655 microversion: 2.20 time: 0.092891 Oct 29 01:34:59.821825 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 463/917] 10.222.0.87 () {62 vars in 1318 bytes} [Fri Oct 29 01:34:59 2021] POST /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a/action => generated 28655 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:34:59.832507 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-144e2977-bf40-4351-9677-33ee34b08bf1 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:34:59.833447 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-144e2977-bf40-4351-9677-33ee34b08bf1 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: ba08d2b5-ae9e-43db-b376-18011c8863f6] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:34:59.839824 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-144e2977-bf40-4351-9677-33ee34b08bf1 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:59.840275 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-144e2977-bf40-4351-9677-33ee34b08bf1 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:59.841048 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-144e2977-bf40-4351-9677-33ee34b08bf1 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:34:59.841478 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-144e2977-bf40-4351-9677-33ee34b08bf1 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:34:59.919551 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-144e2977-bf40-4351-9677-33ee34b08bf1 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "POST /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6/action" status: 200 len: 28635 microversion: 2.1 time: 0.090796 Oct 29 01:34:59.920226 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 455/918] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:34:59 2021] POST /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6/action => generated 28635 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 01:35:00.370790 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-239f99e1-9825-4b4b-bc27-884628d30e0d tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:00.371486 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-239f99e1-9825-4b4b-bc27-884628d30e0d tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] [instance: 1faefe62-60e7-43c3-bf58-686598242ea3] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:35:00.379690 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-239f99e1-9825-4b4b-bc27-884628d30e0d tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:00.380158 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-239f99e1-9825-4b4b-bc27-884628d30e0d tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:00.380939 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-239f99e1-9825-4b4b-bc27-884628d30e0d tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:00.381404 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-239f99e1-9825-4b4b-bc27-884628d30e0d tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:00.556348 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-239f99e1-9825-4b4b-bc27-884628d30e0d tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1147a77b5da48f9a75cefa0ab0e6b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700a9aa6afdf4de6b64d375544d7eb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:00.569374 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-239f99e1-9825-4b4b-bc27-884628d30e0d tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] 10.222.0.87 "GET /compute/v2.1/servers/1faefe62-60e7-43c3-bf58-686598242ea3" status: 200 len: 1358 microversion: 2.1 time: 0.201287 Oct 29 01:35:00.570630 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 464/919] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:35:00 2021] GET /compute/v2.1/servers/1faefe62-60e7-43c3-bf58-686598242ea3 => generated 1358 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:35:00.838704 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-b11f21c3-bd56-4e6d-b1cf-82f4f201c5ec tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:35:00.841694 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-b11f21c3-bd56-4e6d-b1cf-82f4f201c5ec tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:35:00.852417 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-b11f21c3-bd56-4e6d-b1cf-82f4f201c5ec tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:00.853135 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-b11f21c3-bd56-4e6d-b1cf-82f4f201c5ec tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:00.854314 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-b11f21c3-bd56-4e6d-b1cf-82f4f201c5ec tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:00.855394 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-b11f21c3-bd56-4e6d-b1cf-82f4f201c5ec tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:00.931086 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-f0e56735-58f4-4c6d-a7f2-f2354381bc09 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:35:00.932197 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-f0e56735-58f4-4c6d-a7f2-f2354381bc09 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: ba08d2b5-ae9e-43db-b376-18011c8863f6] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:35:00.940781 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-f0e56735-58f4-4c6d-a7f2-f2354381bc09 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:00.941230 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-f0e56735-58f4-4c6d-a7f2-f2354381bc09 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:00.942003 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-f0e56735-58f4-4c6d-a7f2-f2354381bc09 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:00.942616 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-f0e56735-58f4-4c6d-a7f2-f2354381bc09 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:13.490856 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-f0e56735-58f4-4c6d-a7f2-f2354381bc09 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "POST /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6/action" status: 200 len: 38158 microversion: 2.1 time: 12.563135 Oct 29 01:35:13.491569 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 465/920] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:35:00 2021] POST /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6/action => generated 38158 bytes in 12565 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 01:35:13.496424 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [req-c6f592c3-ab9e-4b09-b081-01c32e70d99b req-4c542ff3-2c63-4c3f-8bee-50543652e2b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1faefe62-60e7-43c3-bf58-686598242ea3", "tag": "07d7a9e4-9af6-436e-932a-680c81d02f15"}]} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:35:13.497855 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:35:13.497855 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: warnings.warn(msg) Oct 29 01:35:13.505831 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-b11f21c3-bd56-4e6d-b1cf-82f4f201c5ec tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "POST /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a/action" status: 200 len: 38202 microversion: 2.20 time: 12.674343 Oct 29 01:35:13.506758 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [req-c6f592c3-ab9e-4b09-b081-01c32e70d99b req-4c542ff3-2c63-4c3f-8bee-50543652e2b1 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:13.506924 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [req-c6f592c3-ab9e-4b09-b081-01c32e70d99b req-4c542ff3-2c63-4c3f-8bee-50543652e2b1 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:13.507647 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 456/921] 10.222.0.87 () {62 vars in 1318 bytes} [Fri Oct 29 01:35:00 2021] POST /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a/action => generated 38202 bytes in 12677 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:35:13.515056 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-5909201d-d3d0-465b-904e-ba8352c684a0 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:13.516262 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-5909201d-d3d0-465b-904e-ba8352c684a0 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] [instance: 1faefe62-60e7-43c3-bf58-686598242ea3] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:35:13.519770 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.compute.server_external_events [req-c6f592c3-ab9e-4b09-b081-01c32e70d99b req-4c542ff3-2c63-4c3f-8bee-50543652e2b1 service nova] Creating event network-changed:07d7a9e4-9af6-436e-932a-680c81d02f15 for instance 1faefe62-60e7-43c3-bf58-686598242ea3 on hv-cinder-81398 Oct 29 01:35:13.525042 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [req-c6f592c3-ab9e-4b09-b081-01c32e70d99b req-4c542ff3-2c63-4c3f-8bee-50543652e2b1 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032315 Oct 29 01:35:13.525641 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 466/922] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Oct 29 01:35:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:35:13.531281 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-5909201d-d3d0-465b-904e-ba8352c684a0 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:13.534266 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-5909201d-d3d0-465b-904e-ba8352c684a0 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:13.534266 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-5909201d-d3d0-465b-904e-ba8352c684a0 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:13.534266 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-5909201d-d3d0-465b-904e-ba8352c684a0 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:13.750256 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-5909201d-d3d0-465b-904e-ba8352c684a0 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1147a77b5da48f9a75cefa0ab0e6b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700a9aa6afdf4de6b64d375544d7eb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:13.758079 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-5909201d-d3d0-465b-904e-ba8352c684a0 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] 10.222.0.87 "GET /compute/v2.1/servers/1faefe62-60e7-43c3-bf58-686598242ea3" status: 200 len: 1358 microversion: 2.1 time: 0.248875 Oct 29 01:35:13.768345 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 457/923] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:35:13 2021] GET /compute/v2.1/servers/1faefe62-60e7-43c3-bf58-686598242ea3 => generated 1358 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:35:14.504268 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-8e246de1-f984-45fb-96f5-782fd9523c4a tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:35:14.505291 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-8e246de1-f984-45fb-96f5-782fd9523c4a tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: ba08d2b5-ae9e-43db-b376-18011c8863f6] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:35:14.511288 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-8e246de1-f984-45fb-96f5-782fd9523c4a tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:14.511759 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-8e246de1-f984-45fb-96f5-782fd9523c4a tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:14.512525 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-8e246de1-f984-45fb-96f5-782fd9523c4a tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:14.512955 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-8e246de1-f984-45fb-96f5-782fd9523c4a tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:14.519171 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-99515b4f-912f-4a49-9f95-6eefaef912fb tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:35:14.520123 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-99515b4f-912f-4a49-9f95-6eefaef912fb tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:35:14.526591 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-99515b4f-912f-4a49-9f95-6eefaef912fb tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:14.527026 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-99515b4f-912f-4a49-9f95-6eefaef912fb tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:14.527827 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-99515b4f-912f-4a49-9f95-6eefaef912fb tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:14.528254 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-99515b4f-912f-4a49-9f95-6eefaef912fb tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:14.603258 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-8e246de1-f984-45fb-96f5-782fd9523c4a tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "POST /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6/action" status: 200 len: 38177 microversion: 2.1 time: 0.103698 Oct 29 01:35:14.603853 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 467/924] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:35:14 2021] POST /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6/action => generated 38177 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:35:14.620607 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-99515b4f-912f-4a49-9f95-6eefaef912fb tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "POST /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a/action" status: 200 len: 38220 microversion: 2.20 time: 0.105938 Oct 29 01:35:14.621258 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 458/925] 10.222.0.87 () {62 vars in 1318 bytes} [Fri Oct 29 01:35:14 2021] POST /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a/action => generated 38220 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 29 01:35:14.777631 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-9dd25957-2325-4bae-b76c-cadc31fae205 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:14.778326 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-9dd25957-2325-4bae-b76c-cadc31fae205 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] [instance: 1faefe62-60e7-43c3-bf58-686598242ea3] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:35:14.786097 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-9dd25957-2325-4bae-b76c-cadc31fae205 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:14.786539 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-9dd25957-2325-4bae-b76c-cadc31fae205 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:14.787312 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-9dd25957-2325-4bae-b76c-cadc31fae205 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:14.787753 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-9dd25957-2325-4bae-b76c-cadc31fae205 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:14.923821 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-9dd25957-2325-4bae-b76c-cadc31fae205 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1147a77b5da48f9a75cefa0ab0e6b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700a9aa6afdf4de6b64d375544d7eb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:14.931074 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-9dd25957-2325-4bae-b76c-cadc31fae205 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] 10.222.0.87 "GET /compute/v2.1/servers/1faefe62-60e7-43c3-bf58-686598242ea3" status: 200 len: 1358 microversion: 2.1 time: 0.157714 Oct 29 01:35:14.931645 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 468/926] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:35:14 2021] GET /compute/v2.1/servers/1faefe62-60e7-43c3-bf58-686598242ea3 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:35:15.615628 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-06e0d6d0-4710-471a-9fd8-19455fa668b4 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:35:15.616775 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-06e0d6d0-4710-471a-9fd8-19455fa668b4 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: ba08d2b5-ae9e-43db-b376-18011c8863f6] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:35:15.623510 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-06e0d6d0-4710-471a-9fd8-19455fa668b4 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:15.623976 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-06e0d6d0-4710-471a-9fd8-19455fa668b4 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:15.624764 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-06e0d6d0-4710-471a-9fd8-19455fa668b4 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:15.625188 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-06e0d6d0-4710-471a-9fd8-19455fa668b4 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:15.632037 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-e997e3bd-5d02-4b38-91f7-1e12be85fe3a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:35:15.633065 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-e997e3bd-5d02-4b38-91f7-1e12be85fe3a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:35:15.639267 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-e997e3bd-5d02-4b38-91f7-1e12be85fe3a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:15.639714 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-e997e3bd-5d02-4b38-91f7-1e12be85fe3a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:15.640510 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-e997e3bd-5d02-4b38-91f7-1e12be85fe3a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:15.640935 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-e997e3bd-5d02-4b38-91f7-1e12be85fe3a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:15.711230 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-06e0d6d0-4710-471a-9fd8-19455fa668b4 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "POST /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6/action" status: 200 len: 38289 microversion: 2.1 time: 0.100096 Oct 29 01:35:15.711814 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 459/927] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:35:15 2021] POST /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6/action => generated 38289 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 01:35:15.723022 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-044ea59a-d07a-48fc-a050-005ec2fca1ea tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:15.723585 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-044ea59a-d07a-48fc-a050-005ec2fca1ea tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: ba08d2b5-ae9e-43db-b376-18011c8863f6] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:35:15.730938 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-044ea59a-d07a-48fc-a050-005ec2fca1ea tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:15.731379 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-044ea59a-d07a-48fc-a050-005ec2fca1ea tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:15.732192 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-044ea59a-d07a-48fc-a050-005ec2fca1ea tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:15.732620 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-044ea59a-d07a-48fc-a050-005ec2fca1ea tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:15.745763 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-e997e3bd-5d02-4b38-91f7-1e12be85fe3a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "POST /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a/action" status: 200 len: 38343 microversion: 2.20 time: 0.117160 Oct 29 01:35:15.751416 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 469/928] 10.222.0.87 () {62 vars in 1318 bytes} [Fri Oct 29 01:35:15 2021] POST /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a/action => generated 38343 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 29 01:35:15.763005 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-885e607e-66e5-489f-b616-1eed54ac69de tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:15.763005 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-885e607e-66e5-489f-b616-1eed54ac69de tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:35:15.763260 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-044ea59a-d07a-48fc-a050-005ec2fca1ea tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6/ips" status: 200 len: 145 microversion: 2.1 time: 0.039836 Oct 29 01:35:15.763260 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 460/929] 10.222.0.87 () {58 vars in 1247 bytes} [Fri Oct 29 01:35:15 2021] GET /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6/ips => generated 145 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:35:15.764151 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-885e607e-66e5-489f-b616-1eed54ac69de tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:15.764595 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-885e607e-66e5-489f-b616-1eed54ac69de tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:15.765348 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-885e607e-66e5-489f-b616-1eed54ac69de tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:15.765776 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-885e607e-66e5-489f-b616-1eed54ac69de tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:15.790876 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-885e607e-66e5-489f-b616-1eed54ac69de tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a/ips" status: 200 len: 153 microversion: 2.20 time: 0.038051 Oct 29 01:35:15.797583 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 470/930] 10.222.0.87 () {60 vars in 1288 bytes} [Fri Oct 29 01:35:15 2021] GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a/ips => generated 153 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 01:35:15.948690 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-e5faaf0d-b8dc-4876-b96c-00e622107ee8 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:15.949519 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-e5faaf0d-b8dc-4876-b96c-00e622107ee8 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] [instance: 1faefe62-60e7-43c3-bf58-686598242ea3] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:35:15.957153 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-e5faaf0d-b8dc-4876-b96c-00e622107ee8 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:15.957604 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-e5faaf0d-b8dc-4876-b96c-00e622107ee8 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:15.958383 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-e5faaf0d-b8dc-4876-b96c-00e622107ee8 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:15.958815 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-e5faaf0d-b8dc-4876-b96c-00e622107ee8 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:16.087696 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-e5faaf0d-b8dc-4876-b96c-00e622107ee8 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1147a77b5da48f9a75cefa0ab0e6b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700a9aa6afdf4de6b64d375544d7eb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:16.095610 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-e5faaf0d-b8dc-4876-b96c-00e622107ee8 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] 10.222.0.87 "GET /compute/v2.1/servers/1faefe62-60e7-43c3-bf58-686598242ea3" status: 200 len: 1358 microversion: 2.1 time: 0.150218 Oct 29 01:35:16.096224 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 461/931] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:35:15 2021] GET /compute/v2.1/servers/1faefe62-60e7-43c3-bf58-686598242ea3 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:35:17.113172 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-b0700409-2ab4-46b9-a3b7-30bf50304096 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:17.118518 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-b0700409-2ab4-46b9-a3b7-30bf50304096 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] [instance: 1faefe62-60e7-43c3-bf58-686598242ea3] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:35:17.120206 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-b0700409-2ab4-46b9-a3b7-30bf50304096 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:17.120722 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-b0700409-2ab4-46b9-a3b7-30bf50304096 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:17.121493 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-b0700409-2ab4-46b9-a3b7-30bf50304096 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:17.121916 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-b0700409-2ab4-46b9-a3b7-30bf50304096 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:17.250641 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-b0700409-2ab4-46b9-a3b7-30bf50304096 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1147a77b5da48f9a75cefa0ab0e6b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700a9aa6afdf4de6b64d375544d7eb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:17.259365 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-b0700409-2ab4-46b9-a3b7-30bf50304096 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] 10.222.0.87 "GET /compute/v2.1/servers/1faefe62-60e7-43c3-bf58-686598242ea3" status: 200 len: 1358 microversion: 2.1 time: 0.150370 Oct 29 01:35:17.260026 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 471/932] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:35:17 2021] GET /compute/v2.1/servers/1faefe62-60e7-43c3-bf58-686598242ea3 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:35:17.802603 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-9f3a9b8b-60af-4a11-9a44-4eb5c390ad41 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d29f3295-2315-48d5-bb89-640e0ca58d67"}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:35:17.805234 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-9f3a9b8b-60af-4a11-9a44-4eb5c390ad41 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: ba08d2b5-ae9e-43db-b376-18011c8863f6] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:35:17.809959 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-9f3a9b8b-60af-4a11-9a44-4eb5c390ad41 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:17.810403 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-9f3a9b8b-60af-4a11-9a44-4eb5c390ad41 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:17.811163 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-9f3a9b8b-60af-4a11-9a44-4eb5c390ad41 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:17.811593 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-9f3a9b8b-60af-4a11-9a44-4eb5c390ad41 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:18.275475 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-4d1235f6-8829-411a-ac03-e1ed5389c2b0 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:18.276109 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-4d1235f6-8829-411a-ac03-e1ed5389c2b0 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] [instance: 1faefe62-60e7-43c3-bf58-686598242ea3] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:35:18.282244 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4d1235f6-8829-411a-ac03-e1ed5389c2b0 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:18.282683 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4d1235f6-8829-411a-ac03-e1ed5389c2b0 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:18.283695 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4d1235f6-8829-411a-ac03-e1ed5389c2b0 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:18.284290 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4d1235f6-8829-411a-ac03-e1ed5389c2b0 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:18.409298 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-4d1235f6-8829-411a-ac03-e1ed5389c2b0 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1147a77b5da48f9a75cefa0ab0e6b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700a9aa6afdf4de6b64d375544d7eb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:18.416610 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-4d1235f6-8829-411a-ac03-e1ed5389c2b0 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] 10.222.0.87 "GET /compute/v2.1/servers/1faefe62-60e7-43c3-bf58-686598242ea3" status: 200 len: 1358 microversion: 2.1 time: 0.144956 Oct 29 01:35:18.417184 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 472/933] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:35:18 2021] GET /compute/v2.1/servers/1faefe62-60e7-43c3-bf58-686598242ea3 => generated 1358 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:35:18.650155 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-9f3a9b8b-60af-4a11-9a44-4eb5c390ad41 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "POST /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.851746 Oct 29 01:35:18.650759 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 462/934] 10.222.0.87 () {60 vars in 1322 bytes} [Fri Oct 29 01:35:17 2021] POST /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6/os-volume_attachments => generated 194 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:35:18.775153 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-e25dcbfe-98ec-4cf5-8c67-42ac2b809647 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:35:18.775679 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-e25dcbfe-98ec-4cf5-8c67-42ac2b809647 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:35:18.782242 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-e25dcbfe-98ec-4cf5-8c67-42ac2b809647 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:18.782689 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-e25dcbfe-98ec-4cf5-8c67-42ac2b809647 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:18.783819 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-e25dcbfe-98ec-4cf5-8c67-42ac2b809647 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:18.784327 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-e25dcbfe-98ec-4cf5-8c67-42ac2b809647 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:18.809807 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.objects.instance [None req-e25dcbfe-98ec-4cf5-8c67-42ac2b809647 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lazy-loading 'flavor' on Instance uuid 91b62925-d26a-4afb-bab2-c0288f74404a {{(pid=116378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 01:35:19.301128 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [req-5b759e71-b703-4f7b-990a-79dab4fef7ee req-7640d190-1798-4e69-bf2d-91bd76e7aeb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1faefe62-60e7-43c3-bf58-686598242ea3", "name": "network-vif-plugged", "status": "completed", "tag": "07d7a9e4-9af6-436e-932a-680c81d02f15"}]} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:35:19.302709 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:35:19.302709 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: warnings.warn(msg) Oct 29 01:35:19.311250 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [req-5b759e71-b703-4f7b-990a-79dab4fef7ee req-7640d190-1798-4e69-bf2d-91bd76e7aeb0 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:19.311684 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [req-5b759e71-b703-4f7b-990a-79dab4fef7ee req-7640d190-1798-4e69-bf2d-91bd76e7aeb0 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:19.322478 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.compute.server_external_events [req-5b759e71-b703-4f7b-990a-79dab4fef7ee req-7640d190-1798-4e69-bf2d-91bd76e7aeb0 service nova] Creating event network-vif-plugged:07d7a9e4-9af6-436e-932a-680c81d02f15 for instance 1faefe62-60e7-43c3-bf58-686598242ea3 on hv-cinder-81398 Oct 29 01:35:19.327524 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [req-5b759e71-b703-4f7b-990a-79dab4fef7ee req-7640d190-1798-4e69-bf2d-91bd76e7aeb0 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160565 Oct 29 01:35:19.339651 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 463/935] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Oct 29 01:35:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:35:19.433631 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-f7be78db-acc5-4393-9ff1-f66a388382a7 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:19.434465 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-f7be78db-acc5-4393-9ff1-f66a388382a7 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] [instance: 1faefe62-60e7-43c3-bf58-686598242ea3] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:35:19.440634 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-f7be78db-acc5-4393-9ff1-f66a388382a7 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:19.442833 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-f7be78db-acc5-4393-9ff1-f66a388382a7 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:19.442833 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-f7be78db-acc5-4393-9ff1-f66a388382a7 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:19.442833 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-f7be78db-acc5-4393-9ff1-f66a388382a7 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:19.572606 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-f7be78db-acc5-4393-9ff1-f66a388382a7 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1147a77b5da48f9a75cefa0ab0e6b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700a9aa6afdf4de6b64d375544d7eb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:19.581030 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-f7be78db-acc5-4393-9ff1-f66a388382a7 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] 10.222.0.87 "GET /compute/v2.1/servers/1faefe62-60e7-43c3-bf58-686598242ea3" status: 200 len: 1358 microversion: 2.1 time: 0.151514 Oct 29 01:35:19.581818 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 464/936] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:35:19 2021] GET /compute/v2.1/servers/1faefe62-60e7-43c3-bf58-686598242ea3 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:35:19.598642 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-e25dcbfe-98ec-4cf5-8c67-42ac2b809647 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "POST /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a/action" status: 202 len: 0 microversion: 2.20 time: 0.826535 Oct 29 01:35:19.599458 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 473/937] 10.222.0.87 () {62 vars in 1318 bytes} [Fri Oct 29 01:35:18 2021] POST /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a/action => generated 0 bytes in 829 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:35:19.608727 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-d31daf3f-62bd-430c-86ef-a2a1e8cd1c80 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:19.609736 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-d31daf3f-62bd-430c-86ef-a2a1e8cd1c80 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:35:19.618250 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d31daf3f-62bd-430c-86ef-a2a1e8cd1c80 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:19.618737 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d31daf3f-62bd-430c-86ef-a2a1e8cd1c80 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:19.619798 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d31daf3f-62bd-430c-86ef-a2a1e8cd1c80 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:19.620270 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d31daf3f-62bd-430c-86ef-a2a1e8cd1c80 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:19.778606 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-d31daf3f-62bd-430c-86ef-a2a1e8cd1c80 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:19.788935 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-d31daf3f-62bd-430c-86ef-a2a1e8cd1c80 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:19.790447 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-d31daf3f-62bd-430c-86ef-a2a1e8cd1c80 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:19.791722 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-d31daf3f-62bd-430c-86ef-a2a1e8cd1c80 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a" status: 200 len: 1724 microversion: 2.20 time: 0.187461 Oct 29 01:35:19.792303 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 465/938] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:35:19 2021] GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a => generated 1724 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:35:20.599225 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-f27f879e-338e-4d2b-b4bd-bc26ff511f4d tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:20.600056 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-f27f879e-338e-4d2b-b4bd-bc26ff511f4d tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] [instance: 1faefe62-60e7-43c3-bf58-686598242ea3] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:35:20.606189 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-f27f879e-338e-4d2b-b4bd-bc26ff511f4d tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:20.606630 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-f27f879e-338e-4d2b-b4bd-bc26ff511f4d tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:20.607382 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-f27f879e-338e-4d2b-b4bd-bc26ff511f4d tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:20.607841 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-f27f879e-338e-4d2b-b4bd-bc26ff511f4d tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:20.751799 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-f27f879e-338e-4d2b-b4bd-bc26ff511f4d tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1147a77b5da48f9a75cefa0ab0e6b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700a9aa6afdf4de6b64d375544d7eb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:20.759355 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-f27f879e-338e-4d2b-b4bd-bc26ff511f4d tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] 10.222.0.87 "GET /compute/v2.1/servers/1faefe62-60e7-43c3-bf58-686598242ea3" status: 200 len: 1358 microversion: 2.1 time: 0.164983 Oct 29 01:35:20.759958 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 474/939] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:35:20 2021] GET /compute/v2.1/servers/1faefe62-60e7-43c3-bf58-686598242ea3 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:35:20.810851 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-7eab43a3-2c73-4f26-ab20-c2e8fafddc6a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:20.811445 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-7eab43a3-2c73-4f26-ab20-c2e8fafddc6a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:35:20.818465 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-7eab43a3-2c73-4f26-ab20-c2e8fafddc6a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:20.818902 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-7eab43a3-2c73-4f26-ab20-c2e8fafddc6a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:20.819666 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-7eab43a3-2c73-4f26-ab20-c2e8fafddc6a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:20.820136 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-7eab43a3-2c73-4f26-ab20-c2e8fafddc6a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:20.944865 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-7eab43a3-2c73-4f26-ab20-c2e8fafddc6a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:20.952870 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-7eab43a3-2c73-4f26-ab20-c2e8fafddc6a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:20.954754 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-7eab43a3-2c73-4f26-ab20-c2e8fafddc6a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:20.956917 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-7eab43a3-2c73-4f26-ab20-c2e8fafddc6a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a" status: 200 len: 1724 microversion: 2.20 time: 0.149768 Oct 29 01:35:20.957486 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 466/940] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:35:20 2021] GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:35:21.775971 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-f3f48af5-4ca9-4c2a-97c5-c95e41b207cd tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:21.776585 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-f3f48af5-4ca9-4c2a-97c5-c95e41b207cd tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] [instance: 1faefe62-60e7-43c3-bf58-686598242ea3] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:35:21.782713 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-f3f48af5-4ca9-4c2a-97c5-c95e41b207cd tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:21.783159 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-f3f48af5-4ca9-4c2a-97c5-c95e41b207cd tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:21.783991 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-f3f48af5-4ca9-4c2a-97c5-c95e41b207cd tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:21.784419 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-f3f48af5-4ca9-4c2a-97c5-c95e41b207cd tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:21.904700 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-f3f48af5-4ca9-4c2a-97c5-c95e41b207cd tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1147a77b5da48f9a75cefa0ab0e6b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700a9aa6afdf4de6b64d375544d7eb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:21.912469 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-f3f48af5-4ca9-4c2a-97c5-c95e41b207cd tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] 10.222.0.87 "GET /compute/v2.1/servers/1faefe62-60e7-43c3-bf58-686598242ea3" status: 200 len: 1548 microversion: 2.1 time: 0.140195 Oct 29 01:35:21.913034 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 475/941] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:35:21 2021] GET /compute/v2.1/servers/1faefe62-60e7-43c3-bf58-686598242ea3 => generated 1548 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:35:21.929320 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-830b91a1-0e7f-42e4-a0c6-23f4b50277d8 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:21.929918 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-830b91a1-0e7f-42e4-a0c6-23f4b50277d8 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] [instance: 1faefe62-60e7-43c3-bf58-686598242ea3] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:35:21.936391 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-830b91a1-0e7f-42e4-a0c6-23f4b50277d8 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:21.936840 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-830b91a1-0e7f-42e4-a0c6-23f4b50277d8 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:21.937637 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-830b91a1-0e7f-42e4-a0c6-23f4b50277d8 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:21.938071 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-830b91a1-0e7f-42e4-a0c6-23f4b50277d8 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:21.974833 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-60cce662-4de3-42ad-861b-fbe47f8e8e16 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:21.975429 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-60cce662-4de3-42ad-861b-fbe47f8e8e16 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:35:21.981452 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-60cce662-4de3-42ad-861b-fbe47f8e8e16 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:21.981892 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-60cce662-4de3-42ad-861b-fbe47f8e8e16 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:21.982663 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-60cce662-4de3-42ad-861b-fbe47f8e8e16 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:21.983092 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-60cce662-4de3-42ad-861b-fbe47f8e8e16 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:22.088248 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-830b91a1-0e7f-42e4-a0c6-23f4b50277d8 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1147a77b5da48f9a75cefa0ab0e6b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700a9aa6afdf4de6b64d375544d7eb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:22.095640 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-830b91a1-0e7f-42e4-a0c6-23f4b50277d8 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] 10.222.0.87 "GET /compute/v2.1/servers/1faefe62-60e7-43c3-bf58-686598242ea3" status: 200 len: 1548 microversion: 2.1 time: 0.169971 Oct 29 01:35:22.096866 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 467/942] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:35:21 2021] GET /compute/v2.1/servers/1faefe62-60e7-43c3-bf58-686598242ea3 => generated 1548 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:35:22.111429 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-0b16c4c6-30dd-496e-9024-3fda29d51689 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:22.115619 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:35:22.115619 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: warnings.warn(msg) Oct 29 01:35:22.116628 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-0b16c4c6-30dd-496e-9024-3fda29d51689 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e1147a77b5da48f9a75cefa0ab0e6b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700a9aa6afdf4de6b64d375544d7eb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:22.117357 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-0b16c4c6-30dd-496e-9024-3fda29d51689 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Searching by: {'deleted': False, 'project_id': '700a9aa6afdf4de6b64d375544d7eb88'} {{(pid=116379) get_all /opt/stack/nova/nova/compute/api.py:2905}} Oct 29 01:35:22.123666 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-0b16c4c6-30dd-496e-9024-3fda29d51689 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:22.124135 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-0b16c4c6-30dd-496e-9024-3fda29d51689 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:22.124919 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-0b16c4c6-30dd-496e-9024-3fda29d51689 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:22.125341 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-0b16c4c6-30dd-496e-9024-3fda29d51689 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:22.136701 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-60cce662-4de3-42ad-861b-fbe47f8e8e16 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:22.144411 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-60cce662-4de3-42ad-861b-fbe47f8e8e16 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:22.145892 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-60cce662-4de3-42ad-861b-fbe47f8e8e16 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:22.147030 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-60cce662-4de3-42ad-861b-fbe47f8e8e16 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a" status: 200 len: 1724 microversion: 2.20 time: 0.176447 Oct 29 01:35:22.147589 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 476/943] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:35:21 2021] GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:35:22.213732 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.multi_cell_list [None req-0b16c4c6-30dd-496e-9024-3fda29d51689 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=116379) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Oct 29 01:35:22.308855 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-0b16c4c6-30dd-496e-9024-3fda29d51689 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] 10.222.0.87 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.200865 Oct 29 01:35:22.309436 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 468/944] 10.222.0.87 () {58 vars in 1124 bytes} [Fri Oct 29 01:35:22 2021] GET /compute/v2.1/servers => generated 342 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:35:22.319931 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-08a9335b-a5f3-410f-ac37-3c55009fef0f tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:22.320576 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-08a9335b-a5f3-410f-ac37-3c55009fef0f tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] [instance: 1faefe62-60e7-43c3-bf58-686598242ea3] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:35:22.326341 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-08a9335b-a5f3-410f-ac37-3c55009fef0f tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:22.326785 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-08a9335b-a5f3-410f-ac37-3c55009fef0f tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:22.327538 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-08a9335b-a5f3-410f-ac37-3c55009fef0f tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:22.327998 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-08a9335b-a5f3-410f-ac37-3c55009fef0f tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:22.450098 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-08a9335b-a5f3-410f-ac37-3c55009fef0f tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1147a77b5da48f9a75cefa0ab0e6b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700a9aa6afdf4de6b64d375544d7eb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:22.458219 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-08a9335b-a5f3-410f-ac37-3c55009fef0f tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] 10.222.0.87 "GET /compute/v2.1/servers/1faefe62-60e7-43c3-bf58-686598242ea3" status: 200 len: 1548 microversion: 2.1 time: 0.142091 Oct 29 01:35:22.458785 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 477/945] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:35:22 2021] GET /compute/v2.1/servers/1faefe62-60e7-43c3-bf58-686598242ea3 => generated 1548 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:35:23.166592 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-4bdf06c6-a7ee-4f42-9b03-ed5a534bbd97 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:23.176932 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-4bdf06c6-a7ee-4f42-9b03-ed5a534bbd97 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:35:23.176932 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-4bdf06c6-a7ee-4f42-9b03-ed5a534bbd97 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:23.176932 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-4bdf06c6-a7ee-4f42-9b03-ed5a534bbd97 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:23.176932 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-4bdf06c6-a7ee-4f42-9b03-ed5a534bbd97 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:23.177629 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-4bdf06c6-a7ee-4f42-9b03-ed5a534bbd97 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:23.308836 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-4bdf06c6-a7ee-4f42-9b03-ed5a534bbd97 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:23.314553 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-4bdf06c6-a7ee-4f42-9b03-ed5a534bbd97 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:23.316603 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-4bdf06c6-a7ee-4f42-9b03-ed5a534bbd97 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:23.317765 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-4bdf06c6-a7ee-4f42-9b03-ed5a534bbd97 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a" status: 200 len: 1724 microversion: 2.20 time: 0.154910 Oct 29 01:35:23.318317 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 469/946] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:35:23 2021] GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:35:24.337283 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-5eafb8bd-7b3e-4500-ba4a-5e9c02beca6a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:24.338110 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-5eafb8bd-7b3e-4500-ba4a-5e9c02beca6a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:35:24.345185 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-5eafb8bd-7b3e-4500-ba4a-5e9c02beca6a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:24.345822 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-5eafb8bd-7b3e-4500-ba4a-5e9c02beca6a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:24.361618 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-5eafb8bd-7b3e-4500-ba4a-5e9c02beca6a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:24.361618 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-5eafb8bd-7b3e-4500-ba4a-5e9c02beca6a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:24.405746 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-6b90a12d-6f72-43da-8530-d35ba2b842a5 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "26ab03f7-8592-443d-8e9d-2b03dd5a16e2"}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:35:24.406775 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-6b90a12d-6f72-43da-8530-d35ba2b842a5 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] [instance: 1faefe62-60e7-43c3-bf58-686598242ea3] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:35:24.413447 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-6b90a12d-6f72-43da-8530-d35ba2b842a5 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:24.413913 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-6b90a12d-6f72-43da-8530-d35ba2b842a5 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:24.414685 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-6b90a12d-6f72-43da-8530-d35ba2b842a5 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:24.415121 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-6b90a12d-6f72-43da-8530-d35ba2b842a5 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:24.481625 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-5eafb8bd-7b3e-4500-ba4a-5e9c02beca6a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:24.490055 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-5eafb8bd-7b3e-4500-ba4a-5e9c02beca6a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:24.491689 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-5eafb8bd-7b3e-4500-ba4a-5e9c02beca6a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:24.492843 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-5eafb8bd-7b3e-4500-ba4a-5e9c02beca6a tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a" status: 200 len: 1724 microversion: 2.20 time: 0.160223 Oct 29 01:35:24.493422 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 478/947] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:35:24 2021] GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:35:25.510854 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-d86ef1c0-30b0-4b13-8bfc-d96b53545595 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:25.511516 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-d86ef1c0-30b0-4b13-8bfc-d96b53545595 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:35:25.518412 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-d86ef1c0-30b0-4b13-8bfc-d96b53545595 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:25.518864 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-d86ef1c0-30b0-4b13-8bfc-d96b53545595 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:25.519631 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-d86ef1c0-30b0-4b13-8bfc-d96b53545595 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:25.520085 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-d86ef1c0-30b0-4b13-8bfc-d96b53545595 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:25.547166 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-6b90a12d-6f72-43da-8530-d35ba2b842a5 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] 10.222.0.87 "POST /compute/v2.1/servers/1faefe62-60e7-43c3-bf58-686598242ea3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.145050 Oct 29 01:35:25.552245 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 470/948] 10.222.0.87 () {60 vars in 1322 bytes} [Fri Oct 29 01:35:24 2021] POST /compute/v2.1/servers/1faefe62-60e7-43c3-bf58-686598242ea3/os-volume_attachments => generated 194 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:35:25.650127 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-d86ef1c0-30b0-4b13-8bfc-d96b53545595 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:25.659211 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-d86ef1c0-30b0-4b13-8bfc-d96b53545595 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:25.660945 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-d86ef1c0-30b0-4b13-8bfc-d96b53545595 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:25.662303 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-d86ef1c0-30b0-4b13-8bfc-d96b53545595 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a" status: 200 len: 1724 microversion: 2.20 time: 0.154953 Oct 29 01:35:25.662643 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 479/949] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:35:25 2021] GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:35:26.681276 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-bbb9884c-d70a-4629-a943-48375c932fad tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:26.681964 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-bbb9884c-d70a-4629-a943-48375c932fad tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:35:26.688093 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-bbb9884c-d70a-4629-a943-48375c932fad tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:26.688541 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-bbb9884c-d70a-4629-a943-48375c932fad tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:26.689325 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-bbb9884c-d70a-4629-a943-48375c932fad tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:26.689756 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-bbb9884c-d70a-4629-a943-48375c932fad tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:26.815672 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-bbb9884c-d70a-4629-a943-48375c932fad tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:26.826005 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-bbb9884c-d70a-4629-a943-48375c932fad tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:26.827922 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-bbb9884c-d70a-4629-a943-48375c932fad tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:26.829561 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-bbb9884c-d70a-4629-a943-48375c932fad tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a" status: 200 len: 1724 microversion: 2.20 time: 0.152736 Oct 29 01:35:26.830230 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 471/950] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:35:26 2021] GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:35:27.184875 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-0545682d-9c98-4254-b11e-8b25761fc12c tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:27.185976 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-0545682d-9c98-4254-b11e-8b25761fc12c tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: ba08d2b5-ae9e-43db-b376-18011c8863f6] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:35:27.193712 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-0545682d-9c98-4254-b11e-8b25761fc12c tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:27.194243 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-0545682d-9c98-4254-b11e-8b25761fc12c tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:27.195203 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-0545682d-9c98-4254-b11e-8b25761fc12c tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:27.195745 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-0545682d-9c98-4254-b11e-8b25761fc12c tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:27.233178 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-0545682d-9c98-4254-b11e-8b25761fc12c tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052638 Oct 29 01:35:27.233829 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 480/951] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Oct 29 01:35:27 2021] GET /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:35:27.245307 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-cd7f0a14-b4cf-43d1-b5fb-aeed31a2cad7 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:27.245786 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-cd7f0a14-b4cf-43d1-b5fb-aeed31a2cad7 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: ba08d2b5-ae9e-43db-b376-18011c8863f6] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:35:27.251628 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-cd7f0a14-b4cf-43d1-b5fb-aeed31a2cad7 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:27.252096 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-cd7f0a14-b4cf-43d1-b5fb-aeed31a2cad7 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:27.252849 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-cd7f0a14-b4cf-43d1-b5fb-aeed31a2cad7 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:27.253275 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-cd7f0a14-b4cf-43d1-b5fb-aeed31a2cad7 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:27.281474 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-cd7f0a14-b4cf-43d1-b5fb-aeed31a2cad7 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6/os-volume_attachments/d29f3295-2315-48d5-bb89-640e0ca58d67" status: 200 len: 194 microversion: 2.1 time: 0.039790 Oct 29 01:35:27.282047 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 472/952] 10.222.0.87 () {58 vars in 1412 bytes} [Fri Oct 29 01:35:27 2021] GET /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6/os-volume_attachments/d29f3295-2315-48d5-bb89-640e0ca58d67 => generated 194 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:35:27.850255 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-df6f9081-f3cf-472c-8b95-e02f0eefd1ae tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:27.850845 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-df6f9081-f3cf-472c-8b95-e02f0eefd1ae tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:35:27.857093 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-df6f9081-f3cf-472c-8b95-e02f0eefd1ae tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:27.857531 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-df6f9081-f3cf-472c-8b95-e02f0eefd1ae tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:27.858371 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-df6f9081-f3cf-472c-8b95-e02f0eefd1ae tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:27.858796 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-df6f9081-f3cf-472c-8b95-e02f0eefd1ae tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:28.000074 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-df6f9081-f3cf-472c-8b95-e02f0eefd1ae tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:28.008018 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-df6f9081-f3cf-472c-8b95-e02f0eefd1ae tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:28.009511 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-df6f9081-f3cf-472c-8b95-e02f0eefd1ae tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:28.010687 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-df6f9081-f3cf-472c-8b95-e02f0eefd1ae tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a" status: 200 len: 1724 microversion: 2.20 time: 0.164822 Oct 29 01:35:28.015802 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 481/953] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:35:27 2021] GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:35:29.019451 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-a07b27bd-2903-42c9-b65b-4a93009a348b tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a96c71e7-a97c-4467-9294-aa1a4b53a26e"}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:35:29.021387 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-a07b27bd-2903-42c9-b65b-4a93009a348b tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: ba08d2b5-ae9e-43db-b376-18011c8863f6] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:35:29.027562 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-a07b27bd-2903-42c9-b65b-4a93009a348b tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:29.027713 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-003ce684-7520-4175-a6a9-7b9a3675c07e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:29.028176 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-a07b27bd-2903-42c9-b65b-4a93009a348b tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:29.028297 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-003ce684-7520-4175-a6a9-7b9a3675c07e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:35:29.028781 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-a07b27bd-2903-42c9-b65b-4a93009a348b tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:29.029203 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-a07b27bd-2903-42c9-b65b-4a93009a348b tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:29.034324 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-003ce684-7520-4175-a6a9-7b9a3675c07e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:29.034770 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-003ce684-7520-4175-a6a9-7b9a3675c07e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:29.035563 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-003ce684-7520-4175-a6a9-7b9a3675c07e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:29.036024 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-003ce684-7520-4175-a6a9-7b9a3675c07e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:29.166333 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-003ce684-7520-4175-a6a9-7b9a3675c07e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:29.174053 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-003ce684-7520-4175-a6a9-7b9a3675c07e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:29.175520 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-003ce684-7520-4175-a6a9-7b9a3675c07e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:29.176855 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-003ce684-7520-4175-a6a9-7b9a3675c07e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a" status: 200 len: 1724 microversion: 2.20 time: 0.152850 Oct 29 01:35:29.177413 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 482/954] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:35:29 2021] GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:35:29.781634 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-a07b27bd-2903-42c9-b65b-4a93009a348b tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "POST /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.765623 Oct 29 01:35:29.782268 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 473/955] 10.222.0.87 () {60 vars in 1322 bytes} [Fri Oct 29 01:35:29 2021] POST /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6/os-volume_attachments => generated 194 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:35:30.195479 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-cbaad57c-05ca-446f-915f-1500904ef0b0 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:30.196062 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-cbaad57c-05ca-446f-915f-1500904ef0b0 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:35:30.202190 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-cbaad57c-05ca-446f-915f-1500904ef0b0 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:30.202634 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-cbaad57c-05ca-446f-915f-1500904ef0b0 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:30.203393 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-cbaad57c-05ca-446f-915f-1500904ef0b0 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:30.204103 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-cbaad57c-05ca-446f-915f-1500904ef0b0 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:30.325476 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-cbaad57c-05ca-446f-915f-1500904ef0b0 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:30.334089 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-cbaad57c-05ca-446f-915f-1500904ef0b0 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:30.335568 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-cbaad57c-05ca-446f-915f-1500904ef0b0 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:30.336750 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-cbaad57c-05ca-446f-915f-1500904ef0b0 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a" status: 200 len: 1745 microversion: 2.20 time: 0.145677 Oct 29 01:35:30.337312 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 483/956] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:35:30 2021] GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a => generated 1745 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:35:31.355116 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-995d20c9-4c6c-482a-891a-d596efec5ace tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:31.355818 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-995d20c9-4c6c-482a-891a-d596efec5ace tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:35:31.362324 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-995d20c9-4c6c-482a-891a-d596efec5ace tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:31.362759 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-995d20c9-4c6c-482a-891a-d596efec5ace tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:31.364125 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-995d20c9-4c6c-482a-891a-d596efec5ace tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:31.364125 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-995d20c9-4c6c-482a-891a-d596efec5ace tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:31.502472 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-995d20c9-4c6c-482a-891a-d596efec5ace tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:31.510329 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-995d20c9-4c6c-482a-891a-d596efec5ace tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:31.511821 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-995d20c9-4c6c-482a-891a-d596efec5ace tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:31.513002 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-995d20c9-4c6c-482a-891a-d596efec5ace tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a" status: 200 len: 1745 microversion: 2.20 time: 0.161918 Oct 29 01:35:31.513517 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 474/957] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:35:31 2021] GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a => generated 1745 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:35:32.531372 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-a9401e8a-bd74-4542-a78f-a8ab45ee42a7 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:32.532036 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-a9401e8a-bd74-4542-a78f-a8ab45ee42a7 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:35:32.538801 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a9401e8a-bd74-4542-a78f-a8ab45ee42a7 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:32.539296 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a9401e8a-bd74-4542-a78f-a8ab45ee42a7 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:32.540147 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a9401e8a-bd74-4542-a78f-a8ab45ee42a7 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:32.540579 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a9401e8a-bd74-4542-a78f-a8ab45ee42a7 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:32.681173 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-a9401e8a-bd74-4542-a78f-a8ab45ee42a7 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:32.689156 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-a9401e8a-bd74-4542-a78f-a8ab45ee42a7 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:32.690619 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-a9401e8a-bd74-4542-a78f-a8ab45ee42a7 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:32.692054 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-a9401e8a-bd74-4542-a78f-a8ab45ee42a7 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a" status: 200 len: 1740 microversion: 2.20 time: 0.164099 Oct 29 01:35:32.692614 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 484/958] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:35:32 2021] GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a => generated 1740 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:35:33.097837 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [req-dde94fc3-49b1-4826-8428-b898764f37cc req-4fd12ba9-eaae-44b2-8ea1-2ba19725da30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91b62925-d26a-4afb-bab2-c0288f74404a", "name": "network-vif-plugged", "status": "completed", "tag": "aee32650-07ba-4e45-a318-0849274af2bf"}]} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:35:33.100283 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:35:33.100283 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: warnings.warn(msg) Oct 29 01:35:33.107624 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [req-dde94fc3-49b1-4826-8428-b898764f37cc req-4fd12ba9-eaae-44b2-8ea1-2ba19725da30 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:33.108103 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [req-dde94fc3-49b1-4826-8428-b898764f37cc req-4fd12ba9-eaae-44b2-8ea1-2ba19725da30 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:33.119640 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.compute.server_external_events [req-dde94fc3-49b1-4826-8428-b898764f37cc req-4fd12ba9-eaae-44b2-8ea1-2ba19725da30 service nova] Creating event network-vif-plugged:aee32650-07ba-4e45-a318-0849274af2bf for instance 91b62925-d26a-4afb-bab2-c0288f74404a on hv-cinder-81398 Oct 29 01:35:33.124229 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [req-dde94fc3-49b1-4826-8428-b898764f37cc req-4fd12ba9-eaae-44b2-8ea1-2ba19725da30 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030120 Oct 29 01:35:33.124837 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 475/959] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Oct 29 01:35:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:35:33.723529 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-e3962d0a-5da8-4bef-afbf-20cea287f229 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:33.725637 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-e3962d0a-5da8-4bef-afbf-20cea287f229 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:35:33.733098 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-e3962d0a-5da8-4bef-afbf-20cea287f229 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:33.733885 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-e3962d0a-5da8-4bef-afbf-20cea287f229 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:33.734748 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-e3962d0a-5da8-4bef-afbf-20cea287f229 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:33.735281 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-e3962d0a-5da8-4bef-afbf-20cea287f229 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:33.899086 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-e3962d0a-5da8-4bef-afbf-20cea287f229 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:33.907476 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-e3962d0a-5da8-4bef-afbf-20cea287f229 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:33.909393 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-e3962d0a-5da8-4bef-afbf-20cea287f229 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:33.910914 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-e3962d0a-5da8-4bef-afbf-20cea287f229 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a" status: 200 len: 1740 microversion: 2.20 time: 0.191810 Oct 29 01:35:33.911678 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 485/960] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:35:33 2021] GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a => generated 1740 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:35:34.930724 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-bbe4dcaa-3ac0-48e2-8a27-4e609a47d3ad tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:34.932474 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-bbe4dcaa-3ac0-48e2-8a27-4e609a47d3ad tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:35:34.939081 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-bbe4dcaa-3ac0-48e2-8a27-4e609a47d3ad tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:34.939459 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-bbe4dcaa-3ac0-48e2-8a27-4e609a47d3ad tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:34.940286 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-bbe4dcaa-3ac0-48e2-8a27-4e609a47d3ad tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:34.940712 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-bbe4dcaa-3ac0-48e2-8a27-4e609a47d3ad tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:35.089182 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-bbe4dcaa-3ac0-48e2-8a27-4e609a47d3ad tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:35.099524 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-bbe4dcaa-3ac0-48e2-8a27-4e609a47d3ad tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:35.101374 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-bbe4dcaa-3ac0-48e2-8a27-4e609a47d3ad tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:35.109648 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-bbe4dcaa-3ac0-48e2-8a27-4e609a47d3ad tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a" status: 200 len: 1740 microversion: 2.20 time: 0.176988 Oct 29 01:35:35.109648 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 476/961] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:35:34 2021] GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a => generated 1740 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:35:35.297516 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-d399cf95-12aa-4bda-8d0c-881a0f9e53e0 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:35.298803 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-d399cf95-12aa-4bda-8d0c-881a0f9e53e0 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] [instance: 1faefe62-60e7-43c3-bf58-686598242ea3] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:35:35.306045 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-d399cf95-12aa-4bda-8d0c-881a0f9e53e0 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:35.306486 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-d399cf95-12aa-4bda-8d0c-881a0f9e53e0 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:35.307250 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-d399cf95-12aa-4bda-8d0c-881a0f9e53e0 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:35.307681 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-d399cf95-12aa-4bda-8d0c-881a0f9e53e0 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:35.508454 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-d399cf95-12aa-4bda-8d0c-881a0f9e53e0 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1147a77b5da48f9a75cefa0ab0e6b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700a9aa6afdf4de6b64d375544d7eb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:35.518584 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-d399cf95-12aa-4bda-8d0c-881a0f9e53e0 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] 10.222.0.87 "GET /compute/v2.1/servers/1faefe62-60e7-43c3-bf58-686598242ea3" status: 200 len: 1594 microversion: 2.1 time: 0.224687 Oct 29 01:35:35.519360 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 486/962] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:35:35 2021] GET /compute/v2.1/servers/1faefe62-60e7-43c3-bf58-686598242ea3 => generated 1594 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:35:36.121867 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-a7fba3fc-c576-4732-b890-10ddce4c6cb2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:36.122609 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-a7fba3fc-c576-4732-b890-10ddce4c6cb2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:35:36.129518 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-a7fba3fc-c576-4732-b890-10ddce4c6cb2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:36.130106 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-a7fba3fc-c576-4732-b890-10ddce4c6cb2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:36.130871 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-a7fba3fc-c576-4732-b890-10ddce4c6cb2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:36.131297 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-a7fba3fc-c576-4732-b890-10ddce4c6cb2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:36.304997 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-a7fba3fc-c576-4732-b890-10ddce4c6cb2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:36.314122 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-a7fba3fc-c576-4732-b890-10ddce4c6cb2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:36.315819 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-a7fba3fc-c576-4732-b890-10ddce4c6cb2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:36.317899 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-a7fba3fc-c576-4732-b890-10ddce4c6cb2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a" status: 200 len: 1740 microversion: 2.20 time: 0.199977 Oct 29 01:35:36.318942 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 477/963] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:35:36 2021] GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a => generated 1740 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:35:37.339437 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-f0ee3827-5756-40bc-8005-10037dde0a93 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:37.341261 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-f0ee3827-5756-40bc-8005-10037dde0a93 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:35:37.349700 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-f0ee3827-5756-40bc-8005-10037dde0a93 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:37.350144 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-f0ee3827-5756-40bc-8005-10037dde0a93 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:37.351261 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-f0ee3827-5756-40bc-8005-10037dde0a93 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:37.351888 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-f0ee3827-5756-40bc-8005-10037dde0a93 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:37.491160 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-f0ee3827-5756-40bc-8005-10037dde0a93 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:37.503437 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-f0ee3827-5756-40bc-8005-10037dde0a93 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:37.509973 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-f0ee3827-5756-40bc-8005-10037dde0a93 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:37.509973 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-f0ee3827-5756-40bc-8005-10037dde0a93 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a" status: 200 len: 1740 microversion: 2.20 time: 0.177270 Oct 29 01:35:37.510508 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 487/964] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:35:37 2021] GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a => generated 1740 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:35:38.534445 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-ddd69e12-0b5c-4c46-8038-67628748cb22 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:38.534445 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-ddd69e12-0b5c-4c46-8038-67628748cb22 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:35:38.543605 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ddd69e12-0b5c-4c46-8038-67628748cb22 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:38.546742 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [req-41f52209-4985-4fb9-8d42-580f925cd9ae req-9d1e3feb-76e4-4a8a-8996-3b7bf97fee80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1faefe62-60e7-43c3-bf58-686598242ea3", "tag": "07d7a9e4-9af6-436e-932a-680c81d02f15"}]} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:35:38.548025 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ddd69e12-0b5c-4c46-8038-67628748cb22 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:38.548799 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:35:38.548799 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: warnings.warn(msg) Oct 29 01:35:38.549314 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ddd69e12-0b5c-4c46-8038-67628748cb22 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:38.549920 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ddd69e12-0b5c-4c46-8038-67628748cb22 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:38.557495 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [req-41f52209-4985-4fb9-8d42-580f925cd9ae req-9d1e3feb-76e4-4a8a-8996-3b7bf97fee80 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:38.558112 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [req-41f52209-4985-4fb9-8d42-580f925cd9ae req-9d1e3feb-76e4-4a8a-8996-3b7bf97fee80 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:38.587211 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.compute.server_external_events [req-41f52209-4985-4fb9-8d42-580f925cd9ae req-9d1e3feb-76e4-4a8a-8996-3b7bf97fee80 service nova] Creating event network-changed:07d7a9e4-9af6-436e-932a-680c81d02f15 for instance 1faefe62-60e7-43c3-bf58-686598242ea3 on hv-cinder-81398 Oct 29 01:35:38.617092 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [req-41f52209-4985-4fb9-8d42-580f925cd9ae req-9d1e3feb-76e4-4a8a-8996-3b7bf97fee80 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145170 Oct 29 01:35:38.618355 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 478/965] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Oct 29 01:35:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:35:38.948688 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-ddd69e12-0b5c-4c46-8038-67628748cb22 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:38.971840 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-ddd69e12-0b5c-4c46-8038-67628748cb22 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:38.977665 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-ddd69e12-0b5c-4c46-8038-67628748cb22 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:38.981899 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-ddd69e12-0b5c-4c46-8038-67628748cb22 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a" status: 200 len: 1740 microversion: 2.20 time: 0.456513 Oct 29 01:35:38.986443 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 488/966] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:35:38 2021] GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a => generated 1740 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:35:40.006794 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-e6b1c94d-b5e7-4f23-8371-125de996dc79 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:40.007474 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-e6b1c94d-b5e7-4f23-8371-125de996dc79 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:35:40.014378 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-e6b1c94d-b5e7-4f23-8371-125de996dc79 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:40.014953 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-e6b1c94d-b5e7-4f23-8371-125de996dc79 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:40.015935 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-e6b1c94d-b5e7-4f23-8371-125de996dc79 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:40.016363 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-e6b1c94d-b5e7-4f23-8371-125de996dc79 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:40.179323 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-e6b1c94d-b5e7-4f23-8371-125de996dc79 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:40.188087 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-e6b1c94d-b5e7-4f23-8371-125de996dc79 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:40.189666 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-e6b1c94d-b5e7-4f23-8371-125de996dc79 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:40.190818 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-e6b1c94d-b5e7-4f23-8371-125de996dc79 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a" status: 200 len: 1740 microversion: 2.20 time: 0.190295 Oct 29 01:35:40.204677 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 479/967] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:35:39 2021] GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a => generated 1740 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:35:41.214671 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-2a10b2b7-baa1-42e1-a248-e144675b1e1b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:41.215328 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-2a10b2b7-baa1-42e1-a248-e144675b1e1b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:35:41.222500 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-2a10b2b7-baa1-42e1-a248-e144675b1e1b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:41.225728 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-2a10b2b7-baa1-42e1-a248-e144675b1e1b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:41.226791 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-2a10b2b7-baa1-42e1-a248-e144675b1e1b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:41.227405 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-2a10b2b7-baa1-42e1-a248-e144675b1e1b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:41.433804 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-2a10b2b7-baa1-42e1-a248-e144675b1e1b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:41.442473 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-2a10b2b7-baa1-42e1-a248-e144675b1e1b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:41.445036 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-2a10b2b7-baa1-42e1-a248-e144675b1e1b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:41.446913 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-2a10b2b7-baa1-42e1-a248-e144675b1e1b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a" status: 200 len: 1740 microversion: 2.20 time: 0.236723 Oct 29 01:35:41.448375 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 489/968] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:35:41 2021] GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a => generated 1740 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:35:42.059332 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-894d9de1-b6a1-47e0-8573-a4a49b2d1048 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2114764834"}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:35:42.060008 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-894d9de1-b6a1-47e0-8573-a4a49b2d1048 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] [instance: 1faefe62-60e7-43c3-bf58-686598242ea3] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:35:42.067514 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-894d9de1-b6a1-47e0-8573-a4a49b2d1048 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:42.068785 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-894d9de1-b6a1-47e0-8573-a4a49b2d1048 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:42.069871 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-894d9de1-b6a1-47e0-8573-a4a49b2d1048 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:42.070381 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-894d9de1-b6a1-47e0-8573-a4a49b2d1048 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:42.221965 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.network.security_group_api [None req-894d9de1-b6a1-47e0-8573-a4a49b2d1048 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Adding security group 49fa0380-4c13-4599-95bc-665bdded4f90 to port 07d7a9e4-9af6-436e-932a-680c81d02f15 Oct 29 01:35:42.466729 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-f1b7a847-ff52-4ef3-a678-527bfc3880f2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:42.467346 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-f1b7a847-ff52-4ef3-a678-527bfc3880f2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:35:42.482953 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-f1b7a847-ff52-4ef3-a678-527bfc3880f2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:42.484102 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-f1b7a847-ff52-4ef3-a678-527bfc3880f2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:42.485136 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-f1b7a847-ff52-4ef3-a678-527bfc3880f2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:42.485847 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-f1b7a847-ff52-4ef3-a678-527bfc3880f2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:42.668961 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-f1b7a847-ff52-4ef3-a678-527bfc3880f2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:42.676962 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-f1b7a847-ff52-4ef3-a678-527bfc3880f2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:42.678487 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-f1b7a847-ff52-4ef3-a678-527bfc3880f2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:42.679639 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-f1b7a847-ff52-4ef3-a678-527bfc3880f2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a" status: 200 len: 1740 microversion: 2.20 time: 0.216730 Oct 29 01:35:42.680234 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 490/969] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:35:42 2021] GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a => generated 1740 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:35:42.754931 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-1e513605-afbb-4e03-98f8-f5a11e0672a3 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:42.755872 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-1e513605-afbb-4e03-98f8-f5a11e0672a3 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: ba08d2b5-ae9e-43db-b376-18011c8863f6] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:35:42.761645 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-1e513605-afbb-4e03-98f8-f5a11e0672a3 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:42.762091 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-1e513605-afbb-4e03-98f8-f5a11e0672a3 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:42.762949 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-1e513605-afbb-4e03-98f8-f5a11e0672a3 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:42.763496 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-1e513605-afbb-4e03-98f8-f5a11e0672a3 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:42.794650 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-1e513605-afbb-4e03-98f8-f5a11e0672a3 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043460 Oct 29 01:35:42.802319 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 491/970] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Oct 29 01:35:42 2021] GET /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:35:43.035370 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-894d9de1-b6a1-47e0-8573-a4a49b2d1048 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] 10.222.0.87 "POST /compute/v2.1/servers/1faefe62-60e7-43c3-bf58-686598242ea3/action" status: 202 len: 0 microversion: 2.1 time: 0.975483 Oct 29 01:35:43.035370 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 480/971] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:35:42 2021] POST /compute/v2.1/servers/1faefe62-60e7-43c3-bf58-686598242ea3/action => generated 0 bytes in 977 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:35:43.039679 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-b6cf2149-c398-47c5-a1b8-b532e04e4b6a tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:43.040307 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-b6cf2149-c398-47c5-a1b8-b532e04e4b6a tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] [instance: 1faefe62-60e7-43c3-bf58-686598242ea3] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:35:43.096832 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [req-e3bef5c6-69ba-45d8-a7a2-66b91b154771 req-610d29a1-dc92-42e9-8bc1-c89b7e225326 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1faefe62-60e7-43c3-bf58-686598242ea3", "tag": "07d7a9e4-9af6-436e-932a-680c81d02f15"}]} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:35:43.096832 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:35:43.096832 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: warnings.warn(msg) Oct 29 01:35:43.097938 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-b6cf2149-c398-47c5-a1b8-b532e04e4b6a tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:43.097938 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-b6cf2149-c398-47c5-a1b8-b532e04e4b6a tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:43.097938 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-b6cf2149-c398-47c5-a1b8-b532e04e4b6a tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:43.097938 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-b6cf2149-c398-47c5-a1b8-b532e04e4b6a tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:43.098856 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [req-e3bef5c6-69ba-45d8-a7a2-66b91b154771 req-610d29a1-dc92-42e9-8bc1-c89b7e225326 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:43.098856 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [req-e3bef5c6-69ba-45d8-a7a2-66b91b154771 req-610d29a1-dc92-42e9-8bc1-c89b7e225326 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:43.098856 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.compute.server_external_events [req-e3bef5c6-69ba-45d8-a7a2-66b91b154771 req-610d29a1-dc92-42e9-8bc1-c89b7e225326 service nova] Creating event network-changed:07d7a9e4-9af6-436e-932a-680c81d02f15 for instance 1faefe62-60e7-43c3-bf58-686598242ea3 on hv-cinder-81398 Oct 29 01:35:43.098856 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [req-e3bef5c6-69ba-45d8-a7a2-66b91b154771 req-610d29a1-dc92-42e9-8bc1-c89b7e225326 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055394 Oct 29 01:35:43.104047 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 481/972] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Oct 29 01:35:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:35:43.112373 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-ebfa6e3c-79a4-4e9b-ae54-b9e19fca5f42 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:43.115409 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-ebfa6e3c-79a4-4e9b-ae54-b9e19fca5f42 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: ba08d2b5-ae9e-43db-b376-18011c8863f6] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:35:43.123692 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-ebfa6e3c-79a4-4e9b-ae54-b9e19fca5f42 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:43.124402 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-ebfa6e3c-79a4-4e9b-ae54-b9e19fca5f42 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:43.125533 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-ebfa6e3c-79a4-4e9b-ae54-b9e19fca5f42 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:43.126182 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-ebfa6e3c-79a4-4e9b-ae54-b9e19fca5f42 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:43.167439 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-ebfa6e3c-79a4-4e9b-ae54-b9e19fca5f42 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6/os-volume_attachments/d29f3295-2315-48d5-bb89-640e0ca58d67" status: 200 len: 194 microversion: 2.1 time: 0.060675 Oct 29 01:35:43.167439 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 482/973] 10.222.0.87 () {58 vars in 1412 bytes} [Fri Oct 29 01:35:43 2021] GET /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6/os-volume_attachments/d29f3295-2315-48d5-bb89-640e0ca58d67 => generated 194 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:35:43.180671 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-6ba86c87-0fbc-446a-a0c6-4dbc74525e9a tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:43.181759 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-6ba86c87-0fbc-446a-a0c6-4dbc74525e9a tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: ba08d2b5-ae9e-43db-b376-18011c8863f6] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:35:43.188161 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-6ba86c87-0fbc-446a-a0c6-4dbc74525e9a tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:43.190472 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-6ba86c87-0fbc-446a-a0c6-4dbc74525e9a tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:43.192728 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-6ba86c87-0fbc-446a-a0c6-4dbc74525e9a tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:43.193425 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-6ba86c87-0fbc-446a-a0c6-4dbc74525e9a tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:43.279975 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-b6cf2149-c398-47c5-a1b8-b532e04e4b6a tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1147a77b5da48f9a75cefa0ab0e6b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700a9aa6afdf4de6b64d375544d7eb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:43.290621 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-b6cf2149-c398-47c5-a1b8-b532e04e4b6a tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] 10.222.0.87 "GET /compute/v2.1/servers/1faefe62-60e7-43c3-bf58-686598242ea3" status: 200 len: 1760 microversion: 2.1 time: 0.254853 Oct 29 01:35:43.291829 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 492/974] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:35:43 2021] GET /compute/v2.1/servers/1faefe62-60e7-43c3-bf58-686598242ea3 => generated 1760 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:35:43.342919 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.objects.instance [None req-6ba86c87-0fbc-446a-a0c6-4dbc74525e9a tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lazy-loading 'services' on Instance uuid ba08d2b5-ae9e-43db-b376-18011c8863f6 {{(pid=116379) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 01:35:43.698932 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-d922a8f7-c733-4601-bc78-26db3eef1e54 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:43.704462 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-d922a8f7-c733-4601-bc78-26db3eef1e54 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:35:43.707620 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-d922a8f7-c733-4601-bc78-26db3eef1e54 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:43.708369 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-d922a8f7-c733-4601-bc78-26db3eef1e54 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:43.709353 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-d922a8f7-c733-4601-bc78-26db3eef1e54 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:43.709949 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-d922a8f7-c733-4601-bc78-26db3eef1e54 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:43.829582 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-6ba86c87-0fbc-446a-a0c6-4dbc74525e9a tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "DELETE /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6/os-volume_attachments/d29f3295-2315-48d5-bb89-640e0ca58d67" status: 202 len: 0 microversion: 2.1 time: 0.655005 Oct 29 01:35:43.831777 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 483/975] 10.222.0.87 () {58 vars in 1415 bytes} [Fri Oct 29 01:35:43 2021] DELETE /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6/os-volume_attachments/d29f3295-2315-48d5-bb89-640e0ca58d67 => generated 0 bytes in 658 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:35:43.917793 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-d922a8f7-c733-4601-bc78-26db3eef1e54 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:43.926031 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-d922a8f7-c733-4601-bc78-26db3eef1e54 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:43.935244 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-d922a8f7-c733-4601-bc78-26db3eef1e54 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:43.936692 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-d922a8f7-c733-4601-bc78-26db3eef1e54 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a" status: 200 len: 1740 microversion: 2.20 time: 0.241483 Oct 29 01:35:43.937443 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 493/976] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:35:43 2021] GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a => generated 1740 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:35:44.956494 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-400a880b-3ce6-4545-9f4d-9c35c5ce4752 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:44.957174 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-400a880b-3ce6-4545-9f4d-9c35c5ce4752 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:35:44.964065 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-400a880b-3ce6-4545-9f4d-9c35c5ce4752 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:44.964991 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-400a880b-3ce6-4545-9f4d-9c35c5ce4752 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:44.965356 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-400a880b-3ce6-4545-9f4d-9c35c5ce4752 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:44.965716 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-400a880b-3ce6-4545-9f4d-9c35c5ce4752 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:45.100319 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-400a880b-3ce6-4545-9f4d-9c35c5ce4752 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:45.108012 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-400a880b-3ce6-4545-9f4d-9c35c5ce4752 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:45.109497 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-400a880b-3ce6-4545-9f4d-9c35c5ce4752 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:45.110637 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-400a880b-3ce6-4545-9f4d-9c35c5ce4752 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a" status: 200 len: 1740 microversion: 2.20 time: 0.158687 Oct 29 01:35:45.111185 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 484/977] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:35:44 2021] GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a => generated 1740 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:35:46.063526 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-8d391834-91e3-48aa-a34a-55521afaada7 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:46.064179 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-8d391834-91e3-48aa-a34a-55521afaada7 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: ba08d2b5-ae9e-43db-b376-18011c8863f6] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:35:46.070470 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-8d391834-91e3-48aa-a34a-55521afaada7 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:46.070922 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-8d391834-91e3-48aa-a34a-55521afaada7 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:46.071694 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-8d391834-91e3-48aa-a34a-55521afaada7 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:46.072147 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-8d391834-91e3-48aa-a34a-55521afaada7 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:46.101556 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-8d391834-91e3-48aa-a34a-55521afaada7 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6/os-volume_attachments/a96c71e7-a97c-4467-9294-aa1a4b53a26e" status: 200 len: 194 microversion: 2.1 time: 0.041675 Oct 29 01:35:46.102151 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 494/978] 10.222.0.87 () {58 vars in 1412 bytes} [Fri Oct 29 01:35:46 2021] GET /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6/os-volume_attachments/a96c71e7-a97c-4467-9294-aa1a4b53a26e => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:35:46.111687 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-ab00128a-23ce-437a-9528-405a83d17895 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:46.112255 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-ab00128a-23ce-437a-9528-405a83d17895 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: ba08d2b5-ae9e-43db-b376-18011c8863f6] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:35:46.119278 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-ab00128a-23ce-437a-9528-405a83d17895 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:46.119837 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-ab00128a-23ce-437a-9528-405a83d17895 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:46.120677 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-ab00128a-23ce-437a-9528-405a83d17895 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:46.121111 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-ab00128a-23ce-437a-9528-405a83d17895 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:46.129948 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-86cd73dc-c0aa-45a4-81a7-f2b1f0f4d2a1 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:46.130714 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-86cd73dc-c0aa-45a4-81a7-f2b1f0f4d2a1 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:35:46.136700 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-86cd73dc-c0aa-45a4-81a7-f2b1f0f4d2a1 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:46.137224 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-86cd73dc-c0aa-45a4-81a7-f2b1f0f4d2a1 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:46.138282 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-86cd73dc-c0aa-45a4-81a7-f2b1f0f4d2a1 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:46.138802 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-86cd73dc-c0aa-45a4-81a7-f2b1f0f4d2a1 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:46.201436 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.objects.instance [None req-ab00128a-23ce-437a-9528-405a83d17895 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lazy-loading 'services' on Instance uuid ba08d2b5-ae9e-43db-b376-18011c8863f6 {{(pid=116379) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 01:35:46.481058 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-ab00128a-23ce-437a-9528-405a83d17895 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "DELETE /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6/os-volume_attachments/a96c71e7-a97c-4467-9294-aa1a4b53a26e" status: 202 len: 0 microversion: 2.1 time: 0.372846 Oct 29 01:35:46.482057 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 485/979] 10.222.0.87 () {58 vars in 1415 bytes} [Fri Oct 29 01:35:46 2021] DELETE /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6/os-volume_attachments/a96c71e7-a97c-4467-9294-aa1a4b53a26e => generated 0 bytes in 375 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 01:35:46.612599 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-86cd73dc-c0aa-45a4-81a7-f2b1f0f4d2a1 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:46.620324 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-86cd73dc-c0aa-45a4-81a7-f2b1f0f4d2a1 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:46.624050 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-86cd73dc-c0aa-45a4-81a7-f2b1f0f4d2a1 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:46.624968 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-86cd73dc-c0aa-45a4-81a7-f2b1f0f4d2a1 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a" status: 200 len: 1722 microversion: 2.20 time: 0.500004 Oct 29 01:35:46.625523 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 495/980] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:35:46 2021] GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a => generated 1722 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:35:47.644648 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-bdb5173a-bdf4-4c43-bb0e-b0ae74c43fa1 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:47.645280 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-bdb5173a-bdf4-4c43-bb0e-b0ae74c43fa1 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:35:47.651953 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-bdb5173a-bdf4-4c43-bb0e-b0ae74c43fa1 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:47.652403 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-bdb5173a-bdf4-4c43-bb0e-b0ae74c43fa1 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:47.653171 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-bdb5173a-bdf4-4c43-bb0e-b0ae74c43fa1 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:47.653601 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-bdb5173a-bdf4-4c43-bb0e-b0ae74c43fa1 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:47.782070 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-bdb5173a-bdf4-4c43-bb0e-b0ae74c43fa1 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:47.790870 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-bdb5173a-bdf4-4c43-bb0e-b0ae74c43fa1 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:47.792378 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-bdb5173a-bdf4-4c43-bb0e-b0ae74c43fa1 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:47.793512 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-bdb5173a-bdf4-4c43-bb0e-b0ae74c43fa1 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a" status: 200 len: 1722 microversion: 2.20 time: 0.153221 Oct 29 01:35:47.794092 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 486/981] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:35:47 2021] GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:35:48.687454 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-5ef6c65e-6e61-4d21-9ad8-bf24b747e46e tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:48.691874 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-5ef6c65e-6e61-4d21-9ad8-bf24b747e46e tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: ba08d2b5-ae9e-43db-b376-18011c8863f6] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:35:48.696156 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-5ef6c65e-6e61-4d21-9ad8-bf24b747e46e tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:48.696603 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-5ef6c65e-6e61-4d21-9ad8-bf24b747e46e tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:48.697381 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-5ef6c65e-6e61-4d21-9ad8-bf24b747e46e tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:48.697917 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-5ef6c65e-6e61-4d21-9ad8-bf24b747e46e tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:48.728697 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-5ef6c65e-6e61-4d21-9ad8-bf24b747e46e tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045052 Oct 29 01:35:48.729254 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 496/982] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Oct 29 01:35:48 2021] GET /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:35:48.812561 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-3e7b76ef-37f7-45e0-81b8-949ec7164299 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:48.813163 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-3e7b76ef-37f7-45e0-81b8-949ec7164299 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:35:48.820299 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-3e7b76ef-37f7-45e0-81b8-949ec7164299 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:48.820752 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-3e7b76ef-37f7-45e0-81b8-949ec7164299 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:48.821528 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-3e7b76ef-37f7-45e0-81b8-949ec7164299 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:48.821968 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-3e7b76ef-37f7-45e0-81b8-949ec7164299 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:48.852641 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-222df2d0-df66-4594-9fbd-15199ac8bc0e tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:48.853547 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-222df2d0-df66-4594-9fbd-15199ac8bc0e tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: ba08d2b5-ae9e-43db-b376-18011c8863f6] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:35:48.859688 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-222df2d0-df66-4594-9fbd-15199ac8bc0e tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:48.860167 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-222df2d0-df66-4594-9fbd-15199ac8bc0e tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:48.860942 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-222df2d0-df66-4594-9fbd-15199ac8bc0e tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:48.861370 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-222df2d0-df66-4594-9fbd-15199ac8bc0e tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:48.893540 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-222df2d0-df66-4594-9fbd-15199ac8bc0e tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046025 Oct 29 01:35:48.894118 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 497/983] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Oct 29 01:35:48 2021] GET /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 29 01:35:48.951390 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-a34fc1e9-6a29-4f18-aab8-0c875e58622c tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:48.952021 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-a34fc1e9-6a29-4f18-aab8-0c875e58622c tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: ba08d2b5-ae9e-43db-b376-18011c8863f6] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:35:48.952460 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-3e7b76ef-37f7-45e0-81b8-949ec7164299 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:48.958168 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a34fc1e9-6a29-4f18-aab8-0c875e58622c tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:48.960024 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a34fc1e9-6a29-4f18-aab8-0c875e58622c tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:48.960171 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a34fc1e9-6a29-4f18-aab8-0c875e58622c tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:48.960636 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a34fc1e9-6a29-4f18-aab8-0c875e58622c tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:48.963084 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-3e7b76ef-37f7-45e0-81b8-949ec7164299 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:48.964689 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-3e7b76ef-37f7-45e0-81b8-949ec7164299 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:48.965991 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-3e7b76ef-37f7-45e0-81b8-949ec7164299 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a" status: 200 len: 1725 microversion: 2.20 time: 0.157117 Oct 29 01:35:48.966624 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 487/984] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:35:48 2021] GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:35:48.983298 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-fedf6cbb-10e7-4761-af04-65ae25715d4c tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "941279b3-c90f-40ef-bb59-adb1c67efce3"}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:35:48.984478 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-fedf6cbb-10e7-4761-af04-65ae25715d4c tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:35:48.985671 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-a34fc1e9-6a29-4f18-aab8-0c875e58622c tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: ba08d2b5-ae9e-43db-b376-18011c8863f6] Going to try to terminate instance {{(pid=116378) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 29 01:35:48.990502 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-fedf6cbb-10e7-4761-af04-65ae25715d4c tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:49.006383 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-fedf6cbb-10e7-4761-af04-65ae25715d4c tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:49.006383 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-fedf6cbb-10e7-4761-af04-65ae25715d4c tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:49.006383 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-fedf6cbb-10e7-4761-af04-65ae25715d4c tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:49.276016 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-a34fc1e9-6a29-4f18-aab8-0c875e58622c tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "DELETE /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6" status: 204 len: 0 microversion: 2.1 time: 0.326885 Oct 29 01:35:49.276829 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 498/985] 10.222.0.87 () {58 vars in 1238 bytes} [Fri Oct 29 01:35:48 2021] DELETE /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 01:35:49.285036 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-574ca938-a69c-46de-964e-0b0f0bc22f48 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:49.285720 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-574ca938-a69c-46de-964e-0b0f0bc22f48 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: ba08d2b5-ae9e-43db-b376-18011c8863f6] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:35:49.292006 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-574ca938-a69c-46de-964e-0b0f0bc22f48 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:49.292449 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-574ca938-a69c-46de-964e-0b0f0bc22f48 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:49.293211 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-574ca938-a69c-46de-964e-0b0f0bc22f48 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:49.293751 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-574ca938-a69c-46de-964e-0b0f0bc22f48 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:49.422182 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-574ca938-a69c-46de-964e-0b0f0bc22f48 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045dda1ff9b44334954c08e63fcd20c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51a2093a0874d52a08f6e25489ba181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:49.430360 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-574ca938-a69c-46de-964e-0b0f0bc22f48 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6" status: 200 len: 1671 microversion: 2.1 time: 0.149256 Oct 29 01:35:49.430936 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 499/986] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:35:49 2021] GET /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6 => generated 1671 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:35:50.102652 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-fedf6cbb-10e7-4761-af04-65ae25715d4c tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "POST /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.123020 Oct 29 01:35:50.103485 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 488/987] 10.222.0.87 () {62 vars in 1363 bytes} [Fri Oct 29 01:35:48 2021] POST /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a/os-volume_attachments => generated 188 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 01:35:50.213518 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-33e0219d-e894-4f8c-9bf4-52fe0a3a2362 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:50.214037 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-33e0219d-e894-4f8c-9bf4-52fe0a3a2362 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:35:50.220223 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-33e0219d-e894-4f8c-9bf4-52fe0a3a2362 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:50.220661 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-33e0219d-e894-4f8c-9bf4-52fe0a3a2362 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:50.221406 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-33e0219d-e894-4f8c-9bf4-52fe0a3a2362 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:50.221829 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-33e0219d-e894-4f8c-9bf4-52fe0a3a2362 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:50.448894 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-013a18d1-1ef4-45ba-9089-55cc119d32fc tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:50.449443 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-013a18d1-1ef4-45ba-9089-55cc119d32fc tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: ba08d2b5-ae9e-43db-b376-18011c8863f6] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:35:50.455740 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-013a18d1-1ef4-45ba-9089-55cc119d32fc tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:50.456230 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-013a18d1-1ef4-45ba-9089-55cc119d32fc tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:50.457214 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-013a18d1-1ef4-45ba-9089-55cc119d32fc tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:50.457562 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-013a18d1-1ef4-45ba-9089-55cc119d32fc tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:50.581553 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-013a18d1-1ef4-45ba-9089-55cc119d32fc tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045dda1ff9b44334954c08e63fcd20c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51a2093a0874d52a08f6e25489ba181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:50.589397 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-013a18d1-1ef4-45ba-9089-55cc119d32fc tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6" status: 200 len: 1671 microversion: 2.1 time: 0.144349 Oct 29 01:35:50.589956 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 489/988] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:35:50 2021] GET /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6 => generated 1671 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:35:50.862847 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-33e0219d-e894-4f8c-9bf4-52fe0a3a2362 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "DELETE /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a/os-volume_attachments/941279b3-c90f-40ef-bb59-adb1c67efce3" status: 202 len: 0 microversion: 2.20 time: 0.652922 Oct 29 01:35:50.863479 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 500/989] 10.222.0.87 () {60 vars in 1456 bytes} [Fri Oct 29 01:35:50 2021] DELETE /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a/os-volume_attachments/941279b3-c90f-40ef-bb59-adb1c67efce3 => generated 0 bytes in 655 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:35:50.918340 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-289566a7-a050-4bdc-8e9b-3d22dc211491 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:35:50.918902 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-289566a7-a050-4bdc-8e9b-3d22dc211491 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:35:50.925142 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-289566a7-a050-4bdc-8e9b-3d22dc211491 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:50.925595 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-289566a7-a050-4bdc-8e9b-3d22dc211491 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:50.926392 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-289566a7-a050-4bdc-8e9b-3d22dc211491 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:50.926867 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-289566a7-a050-4bdc-8e9b-3d22dc211491 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:51.051226 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [req-c8d20ad8-2258-4d4b-80e3-9f1570c8c35a req-2bef0986-96bb-4364-96d4-251986db9c4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91b62925-d26a-4afb-bab2-c0288f74404a", "name": "network-vif-unplugged", "status": "completed", "tag": "aee32650-07ba-4e45-a318-0849274af2bf"}]} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:35:51.053021 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:35:51.053021 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: warnings.warn(msg) Oct 29 01:35:51.061815 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [req-c8d20ad8-2258-4d4b-80e3-9f1570c8c35a req-2bef0986-96bb-4364-96d4-251986db9c4a service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:51.061815 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [req-c8d20ad8-2258-4d4b-80e3-9f1570c8c35a req-2bef0986-96bb-4364-96d4-251986db9c4a service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:51.072655 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.compute.server_external_events [req-c8d20ad8-2258-4d4b-80e3-9f1570c8c35a req-2bef0986-96bb-4364-96d4-251986db9c4a service nova] Unable to find a host for instance 91b62925-d26a-4afb-bab2-c0288f74404a. Dropping event network-vif-unplugged {{(pid=116378) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Oct 29 01:35:51.073520 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [req-c8d20ad8-2258-4d4b-80e3-9f1570c8c35a req-2bef0986-96bb-4364-96d4-251986db9c4a service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026145 Oct 29 01:35:51.074092 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 501/990] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Oct 29 01:35:51 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 27 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 29 01:35:51.179782 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-289566a7-a050-4bdc-8e9b-3d22dc211491 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "POST /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a/action" status: 202 len: 0 microversion: 2.20 time: 0.265205 Oct 29 01:35:51.183635 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 490/991] 10.222.0.87 () {62 vars in 1318 bytes} [Fri Oct 29 01:35:50 2021] POST /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a/action => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:35:51.188449 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-2ba42cda-7ad6-4b78-a752-0001dd29e517 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:51.189039 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-2ba42cda-7ad6-4b78-a752-0001dd29e517 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:35:51.198801 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-2ba42cda-7ad6-4b78-a752-0001dd29e517 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:51.199298 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-2ba42cda-7ad6-4b78-a752-0001dd29e517 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:51.200209 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-2ba42cda-7ad6-4b78-a752-0001dd29e517 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:51.200507 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-2ba42cda-7ad6-4b78-a752-0001dd29e517 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:51.399370 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-2ba42cda-7ad6-4b78-a752-0001dd29e517 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:51.409126 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-2ba42cda-7ad6-4b78-a752-0001dd29e517 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:51.410748 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-2ba42cda-7ad6-4b78-a752-0001dd29e517 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:51.422961 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-2ba42cda-7ad6-4b78-a752-0001dd29e517 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a" status: 200 len: 1673 microversion: 2.20 time: 0.227288 Oct 29 01:35:51.422961 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 502/992] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:35:51 2021] GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a => generated 1673 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:35:51.607419 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-306a42ec-f035-4c30-a137-f40cca265160 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:51.608522 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-306a42ec-f035-4c30-a137-f40cca265160 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: ba08d2b5-ae9e-43db-b376-18011c8863f6] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:35:51.616562 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-306a42ec-f035-4c30-a137-f40cca265160 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:51.618284 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-306a42ec-f035-4c30-a137-f40cca265160 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:51.618575 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-306a42ec-f035-4c30-a137-f40cca265160 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:51.619013 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-306a42ec-f035-4c30-a137-f40cca265160 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:51.852578 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-306a42ec-f035-4c30-a137-f40cca265160 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045dda1ff9b44334954c08e63fcd20c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51a2093a0874d52a08f6e25489ba181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:51.860322 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-306a42ec-f035-4c30-a137-f40cca265160 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6" status: 200 len: 1671 microversion: 2.1 time: 0.256507 Oct 29 01:35:51.860984 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 491/993] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:35:51 2021] GET /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6 => generated 1671 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:35:52.356488 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [req-9c194da0-86b2-4f66-bdae-ced7d4f3c779 req-ea2253e6-a41d-4f52-8466-94d10354919e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba08d2b5-ae9e-43db-b376-18011c8863f6", "name": "network-vif-deleted", "tag": "334d5ed1-db63-42dc-bee7-9a695829f7de"}]} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:35:52.358378 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:35:52.358378 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: warnings.warn(msg) Oct 29 01:35:52.366618 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [req-9c194da0-86b2-4f66-bdae-ced7d4f3c779 req-ea2253e6-a41d-4f52-8466-94d10354919e service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:52.372113 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [req-9c194da0-86b2-4f66-bdae-ced7d4f3c779 req-ea2253e6-a41d-4f52-8466-94d10354919e service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:52.379434 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.compute.server_external_events [req-9c194da0-86b2-4f66-bdae-ced7d4f3c779 req-ea2253e6-a41d-4f52-8466-94d10354919e service nova] Creating event network-vif-deleted:334d5ed1-db63-42dc-bee7-9a695829f7de for instance ba08d2b5-ae9e-43db-b376-18011c8863f6 on hv-cinder-81398 Oct 29 01:35:52.385665 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [req-9c194da0-86b2-4f66-bdae-ced7d4f3c779 req-ea2253e6-a41d-4f52-8466-94d10354919e service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033418 Oct 29 01:35:52.386924 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 503/994] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Oct 29 01:35:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:35:52.440741 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-506c5dbd-8c01-402e-a0a7-47f93c3d20ca tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:52.440741 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-506c5dbd-8c01-402e-a0a7-47f93c3d20ca tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:35:52.440741 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-506c5dbd-8c01-402e-a0a7-47f93c3d20ca tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:52.442206 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-506c5dbd-8c01-402e-a0a7-47f93c3d20ca tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:52.443228 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-506c5dbd-8c01-402e-a0a7-47f93c3d20ca tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:52.443664 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-506c5dbd-8c01-402e-a0a7-47f93c3d20ca tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:52.604634 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-506c5dbd-8c01-402e-a0a7-47f93c3d20ca tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:52.615895 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-506c5dbd-8c01-402e-a0a7-47f93c3d20ca tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:52.617558 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-506c5dbd-8c01-402e-a0a7-47f93c3d20ca tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:52.618790 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-506c5dbd-8c01-402e-a0a7-47f93c3d20ca tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a" status: 200 len: 1675 microversion: 2.20 time: 0.191763 Oct 29 01:35:52.619709 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 492/995] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:35:52 2021] GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a => generated 1675 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:35:52.878789 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-a0206215-7d62-4a42-a336-8e7170ee2242 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:52.879508 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-a0206215-7d62-4a42-a336-8e7170ee2242 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: ba08d2b5-ae9e-43db-b376-18011c8863f6] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:35:52.885719 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a0206215-7d62-4a42-a336-8e7170ee2242 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:52.886171 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a0206215-7d62-4a42-a336-8e7170ee2242 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:52.887265 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a0206215-7d62-4a42-a336-8e7170ee2242 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:52.887694 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a0206215-7d62-4a42-a336-8e7170ee2242 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:52.918929 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a0206215-7d62-4a42-a336-8e7170ee2242 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:52.919371 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a0206215-7d62-4a42-a336-8e7170ee2242 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:52.919831 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.objects.instance [None req-a0206215-7d62-4a42-a336-8e7170ee2242 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lazy-loading 'fault' on Instance uuid ba08d2b5-ae9e-43db-b376-18011c8863f6 {{(pid=116378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 01:35:52.960750 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-a0206215-7d62-4a42-a336-8e7170ee2242 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045dda1ff9b44334954c08e63fcd20c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c51a2093a0874d52a08f6e25489ba181', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:52.968982 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-a0206215-7d62-4a42-a336-8e7170ee2242 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6" status: 200 len: 1327 microversion: 2.1 time: 0.093330 Oct 29 01:35:52.969738 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 504/996] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:35:52 2021] GET /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6 => generated 1327 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:35:53.638877 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-398c2a3b-7905-4862-ab9f-f6a635a7edc4 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:53.639474 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-398c2a3b-7905-4862-ab9f-f6a635a7edc4 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:35:53.645917 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-398c2a3b-7905-4862-ab9f-f6a635a7edc4 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:53.647083 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-398c2a3b-7905-4862-ab9f-f6a635a7edc4 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:53.647965 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-398c2a3b-7905-4862-ab9f-f6a635a7edc4 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:53.648396 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-398c2a3b-7905-4862-ab9f-f6a635a7edc4 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:53.774591 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-398c2a3b-7905-4862-ab9f-f6a635a7edc4 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:53.782505 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-398c2a3b-7905-4862-ab9f-f6a635a7edc4 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:53.786650 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-398c2a3b-7905-4862-ab9f-f6a635a7edc4 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:53.786650 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-398c2a3b-7905-4862-ab9f-f6a635a7edc4 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a" status: 200 len: 1731 microversion: 2.20 time: 0.151487 Oct 29 01:35:53.786650 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 493/997] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:35:53 2021] GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:35:53.988143 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-a1dea6f6-dbcf-499f-98e0-b12b145d4d5a tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:53.988741 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-a1dea6f6-dbcf-499f-98e0-b12b145d4d5a tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: ba08d2b5-ae9e-43db-b376-18011c8863f6] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:35:53.995615 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a1dea6f6-dbcf-499f-98e0-b12b145d4d5a tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:53.996167 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a1dea6f6-dbcf-499f-98e0-b12b145d4d5a tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:53.997050 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a1dea6f6-dbcf-499f-98e0-b12b145d4d5a tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:53.997544 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a1dea6f6-dbcf-499f-98e0-b12b145d4d5a tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:54.011635 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.wsgi [None req-a1dea6f6-dbcf-499f-98e0-b12b145d4d5a tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] HTTP exception thrown: Instance ba08d2b5-ae9e-43db-b376-18011c8863f6 could not be found. Oct 29 01:35:54.012247 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-a1dea6f6-dbcf-499f-98e0-b12b145d4d5a tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Returning 404 to user: Instance ba08d2b5-ae9e-43db-b376-18011c8863f6 could not be found. {{(pid=116378) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:35:54.013053 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-a1dea6f6-dbcf-499f-98e0-b12b145d4d5a tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6" status: 404 len: 111 microversion: 2.1 time: 0.028673 Oct 29 01:35:54.016783 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 505/998] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:35:53 2021] GET /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:35:54.027433 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-49351b67-5d8c-4595-b3fe-01cb1c3cb967 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '.version_select at 0x7ff62c0ac8b0>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:54.103258 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-49351b67-5d8c-4595-b3fe-01cb1c3cb967 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-522909088" status: 202 len: 0 microversion: 2.1 time: 0.079675 Oct 29 01:35:54.104187 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 494/999] 10.222.0.87 () {58 vars in 1217 bytes} [Fri Oct 29 01:35:54 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-522909088 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:35:54.805708 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-462b2730-74c6-4ee6-83fa-76831b6059ac tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:54.806308 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-462b2730-74c6-4ee6-83fa-76831b6059ac tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:35:54.812175 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-462b2730-74c6-4ee6-83fa-76831b6059ac tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:54.812626 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-462b2730-74c6-4ee6-83fa-76831b6059ac tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:54.813397 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-462b2730-74c6-4ee6-83fa-76831b6059ac tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:54.813828 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-462b2730-74c6-4ee6-83fa-76831b6059ac tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:54.998535 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-462b2730-74c6-4ee6-83fa-76831b6059ac tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:55.010729 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-462b2730-74c6-4ee6-83fa-76831b6059ac tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:55.012827 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-462b2730-74c6-4ee6-83fa-76831b6059ac tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:55.014351 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-462b2730-74c6-4ee6-83fa-76831b6059ac tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a" status: 200 len: 1731 microversion: 2.20 time: 0.213244 Oct 29 01:35:55.014978 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 506/1000] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:35:54 2021] GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a => generated 1731 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:35:56.033553 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-8889f184-447d-4bb5-a711-22549cc7c04f tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:56.035028 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-8889f184-447d-4bb5-a711-22549cc7c04f tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:35:56.042879 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-8889f184-447d-4bb5-a711-22549cc7c04f tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:56.043337 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-8889f184-447d-4bb5-a711-22549cc7c04f tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:56.044146 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-8889f184-447d-4bb5-a711-22549cc7c04f tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:56.044577 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-8889f184-447d-4bb5-a711-22549cc7c04f tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:56.214684 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-8889f184-447d-4bb5-a711-22549cc7c04f tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:56.222886 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-8889f184-447d-4bb5-a711-22549cc7c04f tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:56.224488 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-8889f184-447d-4bb5-a711-22549cc7c04f tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:56.225733 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-8889f184-447d-4bb5-a711-22549cc7c04f tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a" status: 200 len: 1731 microversion: 2.20 time: 0.196394 Oct 29 01:35:56.226301 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 495/1001] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:35:56 2021] GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a => generated 1731 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:35:57.244692 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-9100aa70-b219-4690-9e7b-77cb53bfa86d tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:57.245428 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-9100aa70-b219-4690-9e7b-77cb53bfa86d tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:35:57.251531 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-9100aa70-b219-4690-9e7b-77cb53bfa86d tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:57.252039 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-9100aa70-b219-4690-9e7b-77cb53bfa86d tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:57.252879 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-9100aa70-b219-4690-9e7b-77cb53bfa86d tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:57.253342 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-9100aa70-b219-4690-9e7b-77cb53bfa86d tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:57.398328 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-9100aa70-b219-4690-9e7b-77cb53bfa86d tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:57.406584 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-9100aa70-b219-4690-9e7b-77cb53bfa86d tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:57.408223 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-9100aa70-b219-4690-9e7b-77cb53bfa86d tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:57.409465 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-9100aa70-b219-4690-9e7b-77cb53bfa86d tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a" status: 200 len: 1731 microversion: 2.20 time: 0.169276 Oct 29 01:35:57.410094 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 507/1002] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:35:57 2021] GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a => generated 1731 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:35:57.858948 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-a7252819-9cc7-4e5a-9015-855bf12c7f98 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:57.859546 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-a7252819-9cc7-4e5a-9015-855bf12c7f98 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: ba08d2b5-ae9e-43db-b376-18011c8863f6] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:35:57.868276 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-a7252819-9cc7-4e5a-9015-855bf12c7f98 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:57.870689 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-a7252819-9cc7-4e5a-9015-855bf12c7f98 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:57.872050 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-a7252819-9cc7-4e5a-9015-855bf12c7f98 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:57.872962 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-a7252819-9cc7-4e5a-9015-855bf12c7f98 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:57.889189 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.wsgi [None req-a7252819-9cc7-4e5a-9015-855bf12c7f98 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] HTTP exception thrown: Instance ba08d2b5-ae9e-43db-b376-18011c8863f6 could not be found. Oct 29 01:35:57.889900 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-a7252819-9cc7-4e5a-9015-855bf12c7f98 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Returning 404 to user: Instance ba08d2b5-ae9e-43db-b376-18011c8863f6 could not be found. {{(pid=116379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:35:57.890924 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-a7252819-9cc7-4e5a-9015-855bf12c7f98 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "DELETE /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6" status: 404 len: 111 microversion: 2.1 time: 0.035599 Oct 29 01:35:57.891960 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 496/1003] 10.222.0.87 () {58 vars in 1238 bytes} [Fri Oct 29 01:35:57 2021] DELETE /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:35:57.899379 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-67562f7d-f60e-4899-9973-e081aa786f22 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:57.900204 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-67562f7d-f60e-4899-9973-e081aa786f22 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: ba08d2b5-ae9e-43db-b376-18011c8863f6] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:35:57.906440 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-67562f7d-f60e-4899-9973-e081aa786f22 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:57.906964 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-67562f7d-f60e-4899-9973-e081aa786f22 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:57.907892 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-67562f7d-f60e-4899-9973-e081aa786f22 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:57.908388 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-67562f7d-f60e-4899-9973-e081aa786f22 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:57.929409 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.wsgi [None req-67562f7d-f60e-4899-9973-e081aa786f22 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] HTTP exception thrown: Instance ba08d2b5-ae9e-43db-b376-18011c8863f6 could not be found. Oct 29 01:35:57.929999 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-67562f7d-f60e-4899-9973-e081aa786f22 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Returning 404 to user: Instance ba08d2b5-ae9e-43db-b376-18011c8863f6 could not be found. {{(pid=116378) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:35:57.930936 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-67562f7d-f60e-4899-9973-e081aa786f22 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6" status: 404 len: 111 microversion: 2.1 time: 0.035140 Oct 29 01:35:57.931486 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 508/1004] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:35:57 2021] GET /compute/v2.1/servers/ba08d2b5-ae9e-43db-b376-18011c8863f6 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:35:58.429851 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-0c828c72-c4ed-42d3-bf3c-2d6787eb22a9 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:58.430444 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-0c828c72-c4ed-42d3-bf3c-2d6787eb22a9 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:35:58.436371 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-0c828c72-c4ed-42d3-bf3c-2d6787eb22a9 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:58.443605 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-0c828c72-c4ed-42d3-bf3c-2d6787eb22a9 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:58.443605 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-0c828c72-c4ed-42d3-bf3c-2d6787eb22a9 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:58.443605 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-0c828c72-c4ed-42d3-bf3c-2d6787eb22a9 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:58.572323 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-0c828c72-c4ed-42d3-bf3c-2d6787eb22a9 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:58.581834 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-0c828c72-c4ed-42d3-bf3c-2d6787eb22a9 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:58.583339 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-0c828c72-c4ed-42d3-bf3c-2d6787eb22a9 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:58.585890 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-0c828c72-c4ed-42d3-bf3c-2d6787eb22a9 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a" status: 200 len: 1731 microversion: 2.20 time: 0.159647 Oct 29 01:35:58.586782 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 497/1005] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:35:58 2021] GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a => generated 1731 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:35:59.452696 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-de710200-7cb0-4580-9ad3-7cde034ff672 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:59.453223 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-de710200-7cb0-4580-9ad3-7cde034ff672 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:35:59.459754 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-de710200-7cb0-4580-9ad3-7cde034ff672 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:59.460268 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-de710200-7cb0-4580-9ad3-7cde034ff672 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:59.461068 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-de710200-7cb0-4580-9ad3-7cde034ff672 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:59.461584 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-de710200-7cb0-4580-9ad3-7cde034ff672 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:59.475942 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.wsgi [None req-de710200-7cb0-4580-9ad3-7cde034ff672 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] HTTP exception thrown: Instance 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92 could not be found. Oct 29 01:35:59.476559 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-de710200-7cb0-4580-9ad3-7cde034ff672 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Returning 404 to user: Instance 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92 could not be found. {{(pid=116378) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:35:59.477381 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-de710200-7cb0-4580-9ad3-7cde034ff672 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "DELETE /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92" status: 404 len: 111 microversion: 2.1 time: 0.028413 Oct 29 01:35:59.477924 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 509/1006] 10.222.0.87 () {58 vars in 1238 bytes} [Fri Oct 29 01:35:59 2021] DELETE /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:35:59.486403 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-a5261570-6f3b-4c93-a236-d503be430405 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:59.487288 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-a5261570-6f3b-4c93-a236-d503be430405 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] [instance: 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:35:59.495002 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-a5261570-6f3b-4c93-a236-d503be430405 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:59.495474 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-a5261570-6f3b-4c93-a236-d503be430405 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:59.496298 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-a5261570-6f3b-4c93-a236-d503be430405 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:59.496728 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-a5261570-6f3b-4c93-a236-d503be430405 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:59.510750 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.wsgi [None req-a5261570-6f3b-4c93-a236-d503be430405 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] HTTP exception thrown: Instance 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92 could not be found. Oct 29 01:35:59.511347 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-a5261570-6f3b-4c93-a236-d503be430405 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] Returning 404 to user: Instance 0cc2f3ec-53ba-4b8c-a02a-236f8564eb92 could not be found. {{(pid=116379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:35:59.512360 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-a5261570-6f3b-4c93-a236-d503be430405 tempest-AttachVolumeTestJSON-404728524 tempest-AttachVolumeTestJSON-404728524-project] 10.222.0.87 "GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92" status: 404 len: 111 microversion: 2.1 time: 0.029830 Oct 29 01:35:59.512924 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 498/1007] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:35:59 2021] GET /compute/v2.1/servers/0cc2f3ec-53ba-4b8c-a02a-236f8564eb92 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:35:59.604885 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-30b533f1-f21f-4644-af02-7386fe102de2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:35:59.605616 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-30b533f1-f21f-4644-af02-7386fe102de2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:35:59.613253 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-30b533f1-f21f-4644-af02-7386fe102de2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:59.613918 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-30b533f1-f21f-4644-af02-7386fe102de2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:59.614747 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-30b533f1-f21f-4644-af02-7386fe102de2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:35:59.615931 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-30b533f1-f21f-4644-af02-7386fe102de2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:35:59.887977 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-30b533f1-f21f-4644-af02-7386fe102de2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:59.897554 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-30b533f1-f21f-4644-af02-7386fe102de2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:59.900076 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-30b533f1-f21f-4644-af02-7386fe102de2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:35:59.901585 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-30b533f1-f21f-4644-af02-7386fe102de2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a" status: 200 len: 1731 microversion: 2.20 time: 0.300394 Oct 29 01:35:59.902622 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 510/1008] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:35:59 2021] GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a => generated 1731 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:36:00.921317 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-b08b7fd1-f8f5-43b2-bfab-622d02272faf tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:00.927083 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-b08b7fd1-f8f5-43b2-bfab-622d02272faf tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:00.928770 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-b08b7fd1-f8f5-43b2-bfab-622d02272faf tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:00.929221 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-b08b7fd1-f8f5-43b2-bfab-622d02272faf tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:00.930018 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-b08b7fd1-f8f5-43b2-bfab-622d02272faf tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:00.930457 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-b08b7fd1-f8f5-43b2-bfab-622d02272faf tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:01.510413 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-b08b7fd1-f8f5-43b2-bfab-622d02272faf tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:01.519038 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-b08b7fd1-f8f5-43b2-bfab-622d02272faf tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:01.520552 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-b08b7fd1-f8f5-43b2-bfab-622d02272faf tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:01.521928 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-b08b7fd1-f8f5-43b2-bfab-622d02272faf tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a" status: 200 len: 1731 microversion: 2.20 time: 0.604994 Oct 29 01:36:01.522694 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 499/1009] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:36:00 2021] GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a => generated 1731 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:36:02.540806 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-44b6df1a-d81f-4eb0-8001-c3e03815437b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:02.541470 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-44b6df1a-d81f-4eb0-8001-c3e03815437b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:02.548363 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-44b6df1a-d81f-4eb0-8001-c3e03815437b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:02.548779 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-44b6df1a-d81f-4eb0-8001-c3e03815437b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:02.549592 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-44b6df1a-d81f-4eb0-8001-c3e03815437b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:02.550023 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-44b6df1a-d81f-4eb0-8001-c3e03815437b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:02.847487 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-44b6df1a-d81f-4eb0-8001-c3e03815437b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:02.857184 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-44b6df1a-d81f-4eb0-8001-c3e03815437b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:02.858602 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-44b6df1a-d81f-4eb0-8001-c3e03815437b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:02.859880 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-44b6df1a-d81f-4eb0-8001-c3e03815437b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a" status: 200 len: 1731 microversion: 2.20 time: 0.323702 Oct 29 01:36:02.861239 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 511/1010] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:36:02 2021] GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a => generated 1731 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:36:03.878278 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-4b17f702-9512-421f-8df7-afe85b1dbf50 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:03.880580 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-4b17f702-9512-421f-8df7-afe85b1dbf50 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:03.888641 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-4b17f702-9512-421f-8df7-afe85b1dbf50 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:03.888993 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-4b17f702-9512-421f-8df7-afe85b1dbf50 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:03.889773 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-4b17f702-9512-421f-8df7-afe85b1dbf50 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:03.890201 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-4b17f702-9512-421f-8df7-afe85b1dbf50 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:04.081838 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-4b17f702-9512-421f-8df7-afe85b1dbf50 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:04.092308 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-4b17f702-9512-421f-8df7-afe85b1dbf50 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:04.102465 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-4b17f702-9512-421f-8df7-afe85b1dbf50 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:04.103928 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-4b17f702-9512-421f-8df7-afe85b1dbf50 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a" status: 200 len: 1731 microversion: 2.20 time: 0.229311 Oct 29 01:36:04.105186 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 500/1011] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:36:03 2021] GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a => generated 1731 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:36:05.122017 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-e226fb8b-1426-4b4e-8279-9dbfec423d2d tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:05.122660 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-e226fb8b-1426-4b4e-8279-9dbfec423d2d tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:05.129156 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-e226fb8b-1426-4b4e-8279-9dbfec423d2d tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:05.129759 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-e226fb8b-1426-4b4e-8279-9dbfec423d2d tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:05.131268 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-e226fb8b-1426-4b4e-8279-9dbfec423d2d tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:05.131797 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-e226fb8b-1426-4b4e-8279-9dbfec423d2d tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:05.277333 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-e226fb8b-1426-4b4e-8279-9dbfec423d2d tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:05.285290 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-e226fb8b-1426-4b4e-8279-9dbfec423d2d tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:05.287222 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-e226fb8b-1426-4b4e-8279-9dbfec423d2d tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:05.288711 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-e226fb8b-1426-4b4e-8279-9dbfec423d2d tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a" status: 200 len: 1731 microversion: 2.20 time: 0.170375 Oct 29 01:36:05.289447 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 512/1012] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:36:05 2021] GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a => generated 1731 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:36:05.959240 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-5ea847ef-b7a3-47f5-8bcb-4b0d265704fe tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:36:05.959887 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-5ea847ef-b7a3-47f5-8bcb-4b0d265704fe tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] [instance: 1faefe62-60e7-43c3-bf58-686598242ea3] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:05.966245 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-5ea847ef-b7a3-47f5-8bcb-4b0d265704fe tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:05.966695 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-5ea847ef-b7a3-47f5-8bcb-4b0d265704fe tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:05.967474 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-5ea847ef-b7a3-47f5-8bcb-4b0d265704fe tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:05.967959 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-5ea847ef-b7a3-47f5-8bcb-4b0d265704fe tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:06.220030 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-5ea847ef-b7a3-47f5-8bcb-4b0d265704fe tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] 10.222.0.87 "POST /compute/v2.1/servers/1faefe62-60e7-43c3-bf58-686598242ea3/action" status: 202 len: 0 microversion: 2.1 time: 0.265771 Oct 29 01:36:06.221639 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 501/1013] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:36:05 2021] POST /compute/v2.1/servers/1faefe62-60e7-43c3-bf58-686598242ea3/action => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:36:06.228379 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-89dd7d57-8c75-46ec-8da6-0e59b3d0c87f tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:06.228974 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-89dd7d57-8c75-46ec-8da6-0e59b3d0c87f tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] [instance: 1faefe62-60e7-43c3-bf58-686598242ea3] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:06.235824 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-89dd7d57-8c75-46ec-8da6-0e59b3d0c87f tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:06.236311 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-89dd7d57-8c75-46ec-8da6-0e59b3d0c87f tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:06.237252 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-89dd7d57-8c75-46ec-8da6-0e59b3d0c87f tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:06.237717 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-89dd7d57-8c75-46ec-8da6-0e59b3d0c87f tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:06.307774 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-5442292c-8776-440f-a954-a783192fd963 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:06.308685 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-5442292c-8776-440f-a954-a783192fd963 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:06.315261 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-5442292c-8776-440f-a954-a783192fd963 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:06.315715 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-5442292c-8776-440f-a954-a783192fd963 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:06.316523 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-5442292c-8776-440f-a954-a783192fd963 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:06.316969 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-5442292c-8776-440f-a954-a783192fd963 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:06.393888 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-89dd7d57-8c75-46ec-8da6-0e59b3d0c87f tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1147a77b5da48f9a75cefa0ab0e6b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700a9aa6afdf4de6b64d375544d7eb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:06.403311 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-89dd7d57-8c75-46ec-8da6-0e59b3d0c87f tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] 10.222.0.87 "GET /compute/v2.1/servers/1faefe62-60e7-43c3-bf58-686598242ea3" status: 200 len: 1752 microversion: 2.1 time: 0.178473 Oct 29 01:36:06.409050 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 513/1014] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:36:06 2021] GET /compute/v2.1/servers/1faefe62-60e7-43c3-bf58-686598242ea3 => generated 1752 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:36:06.457603 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-5442292c-8776-440f-a954-a783192fd963 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:06.466374 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-5442292c-8776-440f-a954-a783192fd963 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:06.467817 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-5442292c-8776-440f-a954-a783192fd963 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:06.468991 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-5442292c-8776-440f-a954-a783192fd963 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a" status: 200 len: 1731 microversion: 2.20 time: 0.165473 Oct 29 01:36:06.469781 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 502/1015] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:36:06 2021] GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:36:07.272378 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-9375fd37-fd43-4919-b9eb-cc6edcf86cc7 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:36:07.273212 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-9375fd37-fd43-4919-b9eb-cc6edcf86cc7 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] [instance: 58f3409d-cd2a-4bef-9ae4-2fba782b321f] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:07.279119 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-9375fd37-fd43-4919-b9eb-cc6edcf86cc7 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:07.279563 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-9375fd37-fd43-4919-b9eb-cc6edcf86cc7 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:07.280355 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-9375fd37-fd43-4919-b9eb-cc6edcf86cc7 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:07.280780 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-9375fd37-fd43-4919-b9eb-cc6edcf86cc7 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:07.304106 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.objects.instance [None req-9375fd37-fd43-4919-b9eb-cc6edcf86cc7 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lazy-loading 'flavor' on Instance uuid 58f3409d-cd2a-4bef-9ae4-2fba782b321f {{(pid=116378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 01:36:07.422675 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-6e1509f2-9c98-4a0b-b79b-020c0f91aa42 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:07.424803 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-6e1509f2-9c98-4a0b-b79b-020c0f91aa42 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] [instance: 1faefe62-60e7-43c3-bf58-686598242ea3] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:07.430845 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-6e1509f2-9c98-4a0b-b79b-020c0f91aa42 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:07.431300 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-6e1509f2-9c98-4a0b-b79b-020c0f91aa42 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:07.432375 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-6e1509f2-9c98-4a0b-b79b-020c0f91aa42 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:07.432817 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-6e1509f2-9c98-4a0b-b79b-020c0f91aa42 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:07.591583 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-6e1509f2-9c98-4a0b-b79b-020c0f91aa42 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1147a77b5da48f9a75cefa0ab0e6b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700a9aa6afdf4de6b64d375544d7eb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:07.599417 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-6e1509f2-9c98-4a0b-b79b-020c0f91aa42 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] 10.222.0.87 "GET /compute/v2.1/servers/1faefe62-60e7-43c3-bf58-686598242ea3" status: 200 len: 1752 microversion: 2.1 time: 0.180829 Oct 29 01:36:07.600013 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 503/1016] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:36:07 2021] GET /compute/v2.1/servers/1faefe62-60e7-43c3-bf58-686598242ea3 => generated 1752 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:36:07.604514 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-1b22438f-2e4c-49d4-9c83-1967b9fea7c1 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:07.605248 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-1b22438f-2e4c-49d4-9c83-1967b9fea7c1 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:07.611028 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-1b22438f-2e4c-49d4-9c83-1967b9fea7c1 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:07.611471 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-1b22438f-2e4c-49d4-9c83-1967b9fea7c1 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:07.612411 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-1b22438f-2e4c-49d4-9c83-1967b9fea7c1 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:07.612893 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-1b22438f-2e4c-49d4-9c83-1967b9fea7c1 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:07.746152 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-9375fd37-fd43-4919-b9eb-cc6edcf86cc7 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] 10.222.0.87 "POST /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f/action" status: 202 len: 0 microversion: 2.1 time: 0.478149 Oct 29 01:36:07.746712 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 514/1017] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:36:07 2021] POST /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f/action => generated 0 bytes in 480 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:36:07.754696 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-1b22438f-2e4c-49d4-9c83-1967b9fea7c1 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:07.755148 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-586ee1c5-98a3-48b2-80ac-91204ca2960a tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:07.756384 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-586ee1c5-98a3-48b2-80ac-91204ca2960a tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] [instance: 58f3409d-cd2a-4bef-9ae4-2fba782b321f] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:07.762640 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-586ee1c5-98a3-48b2-80ac-91204ca2960a tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:07.763079 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-586ee1c5-98a3-48b2-80ac-91204ca2960a tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:07.763868 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-586ee1c5-98a3-48b2-80ac-91204ca2960a tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:07.764000 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-1b22438f-2e4c-49d4-9c83-1967b9fea7c1 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:07.764296 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-586ee1c5-98a3-48b2-80ac-91204ca2960a tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:07.765369 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-1b22438f-2e4c-49d4-9c83-1967b9fea7c1 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:07.766562 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-1b22438f-2e4c-49d4-9c83-1967b9fea7c1 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a" status: 200 len: 1731 microversion: 2.20 time: 0.165404 Oct 29 01:36:07.767100 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 504/1018] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:36:07 2021] GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a => generated 1731 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:36:07.888553 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-586ee1c5-98a3-48b2-80ac-91204ca2960a tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c50a525003e427ba5ff9dea8f4ed47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0db42704249b29fba70abbda7991c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:07.896329 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-586ee1c5-98a3-48b2-80ac-91204ca2960a tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] 10.222.0.87 "GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f" status: 200 len: 1570 microversion: 2.1 time: 0.145102 Oct 29 01:36:07.897715 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 515/1019] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:36:07 2021] GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f => generated 1570 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:36:08.511534 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-9a91322a-a1c2-4fea-b566-47c403d828a7 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2053696759", "imageRef": "3b1d5dc6-2b04-4433-9a93-1db6a740092b", "flavorRef": "452", "networks": [{"uuid": "55f0bc8e-67fb-4207-a774-2feb6c3222d3"}]}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:36:08.561871 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.network.neutron [None req-9a91322a-a1c2-4fea-b566-47c403d828a7 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] validate_networks() for [('55f0bc8e-67fb-4207-a774-2feb6c3222d3', None, None, None, None, None)] {{(pid=116379) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 29 01:36:08.616376 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-c2a3be30-d197-4fd0-9cdc-2fe07ce3ec99 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:08.617092 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-c2a3be30-d197-4fd0-9cdc-2fe07ce3ec99 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] [instance: 1faefe62-60e7-43c3-bf58-686598242ea3] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:08.623237 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c2a3be30-d197-4fd0-9cdc-2fe07ce3ec99 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:08.623687 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c2a3be30-d197-4fd0-9cdc-2fe07ce3ec99 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:08.624486 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c2a3be30-d197-4fd0-9cdc-2fe07ce3ec99 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:08.624918 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c2a3be30-d197-4fd0-9cdc-2fe07ce3ec99 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:08.832342 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-c2a3be30-d197-4fd0-9cdc-2fe07ce3ec99 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1147a77b5da48f9a75cefa0ab0e6b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700a9aa6afdf4de6b64d375544d7eb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:08.841136 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-c2a3be30-d197-4fd0-9cdc-2fe07ce3ec99 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] 10.222.0.87 "GET /compute/v2.1/servers/1faefe62-60e7-43c3-bf58-686598242ea3" status: 200 len: 1757 microversion: 2.1 time: 0.228382 Oct 29 01:36:08.841840 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 516/1020] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:36:08 2021] GET /compute/v2.1/servers/1faefe62-60e7-43c3-bf58-686598242ea3 => generated 1757 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:36:08.846430 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-3bed8ecd-4d71-4500-8c70-fa96f323ee54 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:08.847097 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-3bed8ecd-4d71-4500-8c70-fa96f323ee54 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:08.854169 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-3bed8ecd-4d71-4500-8c70-fa96f323ee54 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:08.854643 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-3bed8ecd-4d71-4500-8c70-fa96f323ee54 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:08.855443 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-3bed8ecd-4d71-4500-8c70-fa96f323ee54 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:08.855906 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-3bed8ecd-4d71-4500-8c70-fa96f323ee54 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:09.008517 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.virt.hardware [None req-9a91322a-a1c2-4fea-b566-47c403d828a7 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Flavor limits 0:0:0 {{(pid=116379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:36:09.008939 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.virt.hardware [None req-9a91322a-a1c2-4fea-b566-47c403d828a7 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Image limits 0:0:0 {{(pid=116379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:36:09.009411 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.virt.hardware [None req-9a91322a-a1c2-4fea-b566-47c403d828a7 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Flavor pref 0:0:0 {{(pid=116379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:36:09.009883 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.virt.hardware [None req-9a91322a-a1c2-4fea-b566-47c403d828a7 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Image pref 0:0:0 {{(pid=116379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:36:09.010296 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.virt.hardware [None req-9a91322a-a1c2-4fea-b566-47c403d828a7 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:36:09.020040 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-9a91322a-a1c2-4fea-b566-47c403d828a7 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:09.020521 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-9a91322a-a1c2-4fea-b566-47c403d828a7 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:09.021875 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-9a91322a-a1c2-4fea-b566-47c403d828a7 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:09.022365 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-9a91322a-a1c2-4fea-b566-47c403d828a7 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:09.043447 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.quota [None req-9a91322a-a1c2-4fea-b566-47c403d828a7 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Getting quotas for project b8778e689b6e42e2b16d49b3fe762ac6. Resources: {'instances', 'cores', 'ram'} {{(pid=116379) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 01:36:09.047555 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-3bed8ecd-4d71-4500-8c70-fa96f323ee54 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:09.048155 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.quota [None req-9a91322a-a1c2-4fea-b566-47c403d828a7 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Getting quotas for user 3c7b600cfde24de9809afe2b55db97cf and project b8778e689b6e42e2b16d49b3fe762ac6. Resources: {'instances', 'cores', 'ram'} {{(pid=116379) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 01:36:09.056919 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-3bed8ecd-4d71-4500-8c70-fa96f323ee54 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:09.058820 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-3bed8ecd-4d71-4500-8c70-fa96f323ee54 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:09.060084 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-3bed8ecd-4d71-4500-8c70-fa96f323ee54 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a" status: 200 len: 1731 microversion: 2.20 time: 0.217161 Oct 29 01:36:09.063778 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-9a91322a-a1c2-4fea-b566-47c403d828a7 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Going to run 1 instances... {{(pid=116379) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 29 01:36:09.063990 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 517/1021] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:36:08 2021] GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a => generated 1731 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:36:09.064124 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-9a91322a-a1c2-4fea-b566-47c403d828a7 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] [instance: e680bc8b-1a56-4a4f-b1aa-fd79a9e98da8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3b1d5dc6-2b04-4433-9a93-1db6a740092b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116379) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 29 01:36:09.066460 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-ad452186-b56e-4d0f-9d6e-ccacadd4f692 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:09.067643 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-ad452186-b56e-4d0f-9d6e-ccacadd4f692 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] [instance: 58f3409d-cd2a-4bef-9ae4-2fba782b321f] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:09.074814 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ad452186-b56e-4d0f-9d6e-ccacadd4f692 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:09.075416 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ad452186-b56e-4d0f-9d6e-ccacadd4f692 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:09.076383 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ad452186-b56e-4d0f-9d6e-ccacadd4f692 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:09.076888 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ad452186-b56e-4d0f-9d6e-ccacadd4f692 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:09.243536 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-ad452186-b56e-4d0f-9d6e-ccacadd4f692 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c50a525003e427ba5ff9dea8f4ed47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0db42704249b29fba70abbda7991c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:09.252042 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-9a91322a-a1c2-4fea-b566-47c403d828a7 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.847952 Oct 29 01:36:09.252275 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-ad452186-b56e-4d0f-9d6e-ccacadd4f692 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] 10.222.0.87 "GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f" status: 200 len: 1570 microversion: 2.1 time: 0.189798 Oct 29 01:36:09.252950 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 505/1022] 10.222.0.87 () {60 vars in 1146 bytes} [Fri Oct 29 01:36:08 2021] POST /compute/v2.1/servers => generated 380 bytes in 849 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:36:09.253355 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 518/1023] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:36:09 2021] GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f => generated 1570 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:36:09.264835 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-63163811-efbb-4db7-99e2-82e50cbb8ada tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:09.264835 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-63163811-efbb-4db7-99e2-82e50cbb8ada tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] [instance: e680bc8b-1a56-4a4f-b1aa-fd79a9e98da8] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:09.331477 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-63163811-efbb-4db7-99e2-82e50cbb8ada tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7b600cfde24de9809afe2b55db97cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8778e689b6e42e2b16d49b3fe762ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:09.340693 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-63163811-efbb-4db7-99e2-82e50cbb8ada tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] 10.222.0.87 "GET /compute/v2.1/servers/e680bc8b-1a56-4a4f-b1aa-fd79a9e98da8" status: 200 len: 1218 microversion: 2.1 time: 0.080268 Oct 29 01:36:09.342463 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 506/1024] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:36:09 2021] GET /compute/v2.1/servers/e680bc8b-1a56-4a4f-b1aa-fd79a9e98da8 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:36:09.858916 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-a3f421b6-2982-436f-ab83-aea746959d7a tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:09.859516 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-a3f421b6-2982-436f-ab83-aea746959d7a tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] [instance: 1faefe62-60e7-43c3-bf58-686598242ea3] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:09.866301 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a3f421b6-2982-436f-ab83-aea746959d7a tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:09.866942 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a3f421b6-2982-436f-ab83-aea746959d7a tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:09.867711 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a3f421b6-2982-436f-ab83-aea746959d7a tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:09.868177 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a3f421b6-2982-436f-ab83-aea746959d7a tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:09.992798 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-a3f421b6-2982-436f-ab83-aea746959d7a tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1147a77b5da48f9a75cefa0ab0e6b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700a9aa6afdf4de6b64d375544d7eb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:10.000562 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-a3f421b6-2982-436f-ab83-aea746959d7a tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] 10.222.0.87 "GET /compute/v2.1/servers/1faefe62-60e7-43c3-bf58-686598242ea3" status: 200 len: 1757 microversion: 2.1 time: 0.145230 Oct 29 01:36:10.001119 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 519/1025] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:36:09 2021] GET /compute/v2.1/servers/1faefe62-60e7-43c3-bf58-686598242ea3 => generated 1757 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:36:10.078256 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-88e0e3d8-7f81-4c08-8dce-58e22e3fd9e6 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:10.078846 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-88e0e3d8-7f81-4c08-8dce-58e22e3fd9e6 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:10.085734 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-88e0e3d8-7f81-4c08-8dce-58e22e3fd9e6 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:10.086189 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-88e0e3d8-7f81-4c08-8dce-58e22e3fd9e6 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:10.086966 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-88e0e3d8-7f81-4c08-8dce-58e22e3fd9e6 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:10.087397 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-88e0e3d8-7f81-4c08-8dce-58e22e3fd9e6 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:10.210953 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-88e0e3d8-7f81-4c08-8dce-58e22e3fd9e6 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:10.219025 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-88e0e3d8-7f81-4c08-8dce-58e22e3fd9e6 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:10.220571 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-88e0e3d8-7f81-4c08-8dce-58e22e3fd9e6 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:10.221724 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-88e0e3d8-7f81-4c08-8dce-58e22e3fd9e6 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a" status: 200 len: 1731 microversion: 2.20 time: 0.147237 Oct 29 01:36:10.222275 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 507/1026] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:36:10 2021] GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a => generated 1731 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:36:10.275115 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-74621196-1a66-4c3b-85fc-13006e264c13 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:10.275717 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-74621196-1a66-4c3b-85fc-13006e264c13 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] [instance: 58f3409d-cd2a-4bef-9ae4-2fba782b321f] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:10.281530 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-74621196-1a66-4c3b-85fc-13006e264c13 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:10.281977 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-74621196-1a66-4c3b-85fc-13006e264c13 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:10.282809 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-74621196-1a66-4c3b-85fc-13006e264c13 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:10.283175 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-74621196-1a66-4c3b-85fc-13006e264c13 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:10.358385 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-12fef9f4-b93f-44d4-8dca-51f8666228cc tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:10.358988 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-12fef9f4-b93f-44d4-8dca-51f8666228cc tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] [instance: e680bc8b-1a56-4a4f-b1aa-fd79a9e98da8] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:10.428630 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-12fef9f4-b93f-44d4-8dca-51f8666228cc tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7b600cfde24de9809afe2b55db97cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8778e689b6e42e2b16d49b3fe762ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:10.435403 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-12fef9f4-b93f-44d4-8dca-51f8666228cc tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] 10.222.0.87 "GET /compute/v2.1/servers/e680bc8b-1a56-4a4f-b1aa-fd79a9e98da8" status: 200 len: 1218 microversion: 2.1 time: 0.080861 Oct 29 01:36:10.435754 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-74621196-1a66-4c3b-85fc-13006e264c13 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c50a525003e427ba5ff9dea8f4ed47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0db42704249b29fba70abbda7991c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:10.436067 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 508/1027] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:36:10 2021] GET /compute/v2.1/servers/e680bc8b-1a56-4a4f-b1aa-fd79a9e98da8 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:36:10.444134 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-74621196-1a66-4c3b-85fc-13006e264c13 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] 10.222.0.87 "GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f" status: 200 len: 1570 microversion: 2.1 time: 0.172148 Oct 29 01:36:10.444714 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 520/1028] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:36:10 2021] GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f => generated 1570 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:36:11.018129 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-77dc3f35-1088-4aa6-8481-b1c3f6d3a238 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:11.018737 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-77dc3f35-1088-4aa6-8481-b1c3f6d3a238 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] [instance: 1faefe62-60e7-43c3-bf58-686598242ea3] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:11.027588 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-77dc3f35-1088-4aa6-8481-b1c3f6d3a238 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:11.030191 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-77dc3f35-1088-4aa6-8481-b1c3f6d3a238 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:11.030191 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-77dc3f35-1088-4aa6-8481-b1c3f6d3a238 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:11.030191 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-77dc3f35-1088-4aa6-8481-b1c3f6d3a238 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:11.162716 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-77dc3f35-1088-4aa6-8481-b1c3f6d3a238 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1147a77b5da48f9a75cefa0ab0e6b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700a9aa6afdf4de6b64d375544d7eb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:11.170885 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-77dc3f35-1088-4aa6-8481-b1c3f6d3a238 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] 10.222.0.87 "GET /compute/v2.1/servers/1faefe62-60e7-43c3-bf58-686598242ea3" status: 200 len: 1757 microversion: 2.1 time: 0.156499 Oct 29 01:36:11.171859 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 509/1029] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:36:11 2021] GET /compute/v2.1/servers/1faefe62-60e7-43c3-bf58-686598242ea3 => generated 1757 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:36:11.209854 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [req-8ac63b53-9412-4900-b137-e8c77d8d4404 req-dcc7bc34-8a4a-475e-a1ff-9317625e5e7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91b62925-d26a-4afb-bab2-c0288f74404a", "name": "network-vif-plugged", "status": "completed", "tag": "aee32650-07ba-4e45-a318-0849274af2bf"}]} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:36:11.211664 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:36:11.211664 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: warnings.warn(msg) Oct 29 01:36:11.219511 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [req-8ac63b53-9412-4900-b137-e8c77d8d4404 req-dcc7bc34-8a4a-475e-a1ff-9317625e5e7f service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:11.219912 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [req-8ac63b53-9412-4900-b137-e8c77d8d4404 req-dcc7bc34-8a4a-475e-a1ff-9317625e5e7f service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:11.231396 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.compute.server_external_events [req-8ac63b53-9412-4900-b137-e8c77d8d4404 req-dcc7bc34-8a4a-475e-a1ff-9317625e5e7f service nova] Creating event network-vif-plugged:aee32650-07ba-4e45-a318-0849274af2bf for instance 91b62925-d26a-4afb-bab2-c0288f74404a on hv-cinder-81398 Oct 29 01:36:11.236509 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [req-8ac63b53-9412-4900-b137-e8c77d8d4404 req-dcc7bc34-8a4a-475e-a1ff-9317625e5e7f service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030792 Oct 29 01:36:11.237087 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 521/1030] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Oct 29 01:36:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:36:11.241409 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-4b9bba80-25ac-4be8-892a-e3d76cacc454 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:11.242163 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-4b9bba80-25ac-4be8-892a-e3d76cacc454 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:11.249320 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-4b9bba80-25ac-4be8-892a-e3d76cacc454 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:11.249933 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-4b9bba80-25ac-4be8-892a-e3d76cacc454 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:11.250905 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-4b9bba80-25ac-4be8-892a-e3d76cacc454 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:11.251457 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-4b9bba80-25ac-4be8-892a-e3d76cacc454 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:11.391314 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-4b9bba80-25ac-4be8-892a-e3d76cacc454 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:11.400185 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-4b9bba80-25ac-4be8-892a-e3d76cacc454 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:11.401685 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-4b9bba80-25ac-4be8-892a-e3d76cacc454 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:11.402867 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-4b9bba80-25ac-4be8-892a-e3d76cacc454 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a" status: 200 len: 1731 microversion: 2.20 time: 0.166564 Oct 29 01:36:11.403425 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 510/1031] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:36:11 2021] GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a => generated 1731 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:36:11.453224 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-c992cea0-6d81-49bc-bd03-672186265827 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:11.453884 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-c992cea0-6d81-49bc-bd03-672186265827 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] [instance: e680bc8b-1a56-4a4f-b1aa-fd79a9e98da8] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:11.461372 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c992cea0-6d81-49bc-bd03-672186265827 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:11.462210 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c992cea0-6d81-49bc-bd03-672186265827 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:11.462337 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-75befbe4-7053-427a-8d2f-2a2109167711 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:11.462836 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-75befbe4-7053-427a-8d2f-2a2109167711 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] [instance: 58f3409d-cd2a-4bef-9ae4-2fba782b321f] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:11.463495 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c992cea0-6d81-49bc-bd03-672186265827 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:11.463945 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c992cea0-6d81-49bc-bd03-672186265827 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:11.468980 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-75befbe4-7053-427a-8d2f-2a2109167711 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:11.469428 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-75befbe4-7053-427a-8d2f-2a2109167711 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:11.470614 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-75befbe4-7053-427a-8d2f-2a2109167711 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:11.471048 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-75befbe4-7053-427a-8d2f-2a2109167711 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:11.548031 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-c992cea0-6d81-49bc-bd03-672186265827 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7b600cfde24de9809afe2b55db97cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8778e689b6e42e2b16d49b3fe762ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:11.555630 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-c992cea0-6d81-49bc-bd03-672186265827 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] 10.222.0.87 "GET /compute/v2.1/servers/e680bc8b-1a56-4a4f-b1aa-fd79a9e98da8" status: 200 len: 1270 microversion: 2.1 time: 0.106659 Oct 29 01:36:11.556245 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 522/1032] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:36:11 2021] GET /compute/v2.1/servers/e680bc8b-1a56-4a4f-b1aa-fd79a9e98da8 => generated 1270 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:36:11.645160 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-75befbe4-7053-427a-8d2f-2a2109167711 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c50a525003e427ba5ff9dea8f4ed47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0db42704249b29fba70abbda7991c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:11.654670 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-75befbe4-7053-427a-8d2f-2a2109167711 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] 10.222.0.87 "GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f" status: 200 len: 1570 microversion: 2.1 time: 0.196935 Oct 29 01:36:11.655251 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 511/1033] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:36:11 2021] GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f => generated 1570 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:36:12.188101 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-afe741ff-183c-470b-9684-c900bcc3e6e6 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:12.188738 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-afe741ff-183c-470b-9684-c900bcc3e6e6 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] [instance: 1faefe62-60e7-43c3-bf58-686598242ea3] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:12.194929 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-afe741ff-183c-470b-9684-c900bcc3e6e6 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:12.195368 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-afe741ff-183c-470b-9684-c900bcc3e6e6 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:12.196286 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-afe741ff-183c-470b-9684-c900bcc3e6e6 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:12.196729 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-afe741ff-183c-470b-9684-c900bcc3e6e6 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:12.335192 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-afe741ff-183c-470b-9684-c900bcc3e6e6 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1147a77b5da48f9a75cefa0ab0e6b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700a9aa6afdf4de6b64d375544d7eb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:12.345351 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-afe741ff-183c-470b-9684-c900bcc3e6e6 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] 10.222.0.87 "GET /compute/v2.1/servers/1faefe62-60e7-43c3-bf58-686598242ea3" status: 200 len: 1757 microversion: 2.1 time: 0.161025 Oct 29 01:36:12.345949 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 523/1034] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:36:12 2021] GET /compute/v2.1/servers/1faefe62-60e7-43c3-bf58-686598242ea3 => generated 1757 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:36:12.421061 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-ec902727-5b0f-4f10-8847-5a2dfbd2c63e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:12.421739 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-ec902727-5b0f-4f10-8847-5a2dfbd2c63e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:12.428773 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-ec902727-5b0f-4f10-8847-5a2dfbd2c63e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:12.429218 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-ec902727-5b0f-4f10-8847-5a2dfbd2c63e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:12.430004 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-ec902727-5b0f-4f10-8847-5a2dfbd2c63e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:12.430439 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-ec902727-5b0f-4f10-8847-5a2dfbd2c63e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:12.555702 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-ec902727-5b0f-4f10-8847-5a2dfbd2c63e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:12.563572 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-ec902727-5b0f-4f10-8847-5a2dfbd2c63e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:12.565117 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-ec902727-5b0f-4f10-8847-5a2dfbd2c63e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:12.566268 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-ec902727-5b0f-4f10-8847-5a2dfbd2c63e tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a" status: 200 len: 1731 microversion: 2.20 time: 0.149151 Oct 29 01:36:12.566819 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 512/1035] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:36:12 2021] GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a => generated 1731 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:36:12.572505 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-ab3ce325-f353-4fc3-9db2-5d98b8ee4608 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:12.573129 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-ab3ce325-f353-4fc3-9db2-5d98b8ee4608 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] [instance: e680bc8b-1a56-4a4f-b1aa-fd79a9e98da8] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:12.578875 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ab3ce325-f353-4fc3-9db2-5d98b8ee4608 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:12.579564 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ab3ce325-f353-4fc3-9db2-5d98b8ee4608 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:12.580379 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ab3ce325-f353-4fc3-9db2-5d98b8ee4608 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:12.580979 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ab3ce325-f353-4fc3-9db2-5d98b8ee4608 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:12.672060 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-13525b32-06d5-48d0-8e99-177db7dbd945 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:12.672521 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-13525b32-06d5-48d0-8e99-177db7dbd945 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] [instance: 58f3409d-cd2a-4bef-9ae4-2fba782b321f] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:12.678713 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-13525b32-06d5-48d0-8e99-177db7dbd945 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:12.679471 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-13525b32-06d5-48d0-8e99-177db7dbd945 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:12.680418 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-13525b32-06d5-48d0-8e99-177db7dbd945 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:12.680946 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-13525b32-06d5-48d0-8e99-177db7dbd945 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:12.733122 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-ab3ce325-f353-4fc3-9db2-5d98b8ee4608 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7b600cfde24de9809afe2b55db97cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8778e689b6e42e2b16d49b3fe762ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:12.740594 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-ab3ce325-f353-4fc3-9db2-5d98b8ee4608 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] 10.222.0.87 "GET /compute/v2.1/servers/e680bc8b-1a56-4a4f-b1aa-fd79a9e98da8" status: 200 len: 1318 microversion: 2.1 time: 0.171642 Oct 29 01:36:12.741422 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 524/1036] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:36:12 2021] GET /compute/v2.1/servers/e680bc8b-1a56-4a4f-b1aa-fd79a9e98da8 => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:36:12.813072 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-13525b32-06d5-48d0-8e99-177db7dbd945 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c50a525003e427ba5ff9dea8f4ed47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0db42704249b29fba70abbda7991c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:12.821753 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-13525b32-06d5-48d0-8e99-177db7dbd945 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] 10.222.0.87 "GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f" status: 200 len: 1570 microversion: 2.1 time: 0.153609 Oct 29 01:36:12.822761 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 513/1037] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:36:12 2021] GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:36:13.365354 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-ef520fde-49de-4235-bd43-a230d06c7287 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:13.366974 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-ef520fde-49de-4235-bd43-a230d06c7287 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] [instance: 1faefe62-60e7-43c3-bf58-686598242ea3] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:13.374935 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ef520fde-49de-4235-bd43-a230d06c7287 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:13.376215 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ef520fde-49de-4235-bd43-a230d06c7287 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:13.377056 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ef520fde-49de-4235-bd43-a230d06c7287 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:13.377501 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ef520fde-49de-4235-bd43-a230d06c7287 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:13.591206 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-3bffe78c-d380-4f54-bfaf-1458894537e6 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:13.592982 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-3bffe78c-d380-4f54-bfaf-1458894537e6 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:13.600561 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-3bffe78c-d380-4f54-bfaf-1458894537e6 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:13.601243 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-3bffe78c-d380-4f54-bfaf-1458894537e6 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:13.602192 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-3bffe78c-d380-4f54-bfaf-1458894537e6 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:13.603221 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-3bffe78c-d380-4f54-bfaf-1458894537e6 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:13.603996 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-ef520fde-49de-4235-bd43-a230d06c7287 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1147a77b5da48f9a75cefa0ab0e6b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700a9aa6afdf4de6b64d375544d7eb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:13.617203 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-ef520fde-49de-4235-bd43-a230d06c7287 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] 10.222.0.87 "GET /compute/v2.1/servers/1faefe62-60e7-43c3-bf58-686598242ea3" status: 200 len: 1757 microversion: 2.1 time: 0.256792 Oct 29 01:36:13.619762 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 525/1038] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:36:13 2021] GET /compute/v2.1/servers/1faefe62-60e7-43c3-bf58-686598242ea3 => generated 1757 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:36:13.637724 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [req-da6ce21b-b506-4ffc-aeaa-ef239ce49ac7 req-7ffc6b61-6712-48e0-87ec-665737332fb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e680bc8b-1a56-4a4f-b1aa-fd79a9e98da8", "tag": "4ed04aff-6179-4c33-bfce-b78bc0ab0759"}]} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:36:13.639676 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:36:13.639676 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: warnings.warn(msg) Oct 29 01:36:13.648120 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [req-da6ce21b-b506-4ffc-aeaa-ef239ce49ac7 req-7ffc6b61-6712-48e0-87ec-665737332fb9 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:13.648610 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [req-da6ce21b-b506-4ffc-aeaa-ef239ce49ac7 req-7ffc6b61-6712-48e0-87ec-665737332fb9 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:13.660350 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.compute.server_external_events [req-da6ce21b-b506-4ffc-aeaa-ef239ce49ac7 req-7ffc6b61-6712-48e0-87ec-665737332fb9 service nova] Creating event network-changed:4ed04aff-6179-4c33-bfce-b78bc0ab0759 for instance e680bc8b-1a56-4a4f-b1aa-fd79a9e98da8 on hv-cinder-81398 Oct 29 01:36:13.665424 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [req-da6ce21b-b506-4ffc-aeaa-ef239ce49ac7 req-7ffc6b61-6712-48e0-87ec-665737332fb9 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042641 Oct 29 01:36:13.666098 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 526/1039] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Oct 29 01:36:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:36:13.761386 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-9ee92231-806c-47c3-9e35-4d14e1ea735c tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:13.761386 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-9ee92231-806c-47c3-9e35-4d14e1ea735c tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] [instance: e680bc8b-1a56-4a4f-b1aa-fd79a9e98da8] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:13.766022 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-9ee92231-806c-47c3-9e35-4d14e1ea735c tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:13.766641 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-9ee92231-806c-47c3-9e35-4d14e1ea735c tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:13.767656 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-9ee92231-806c-47c3-9e35-4d14e1ea735c tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:13.768260 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-9ee92231-806c-47c3-9e35-4d14e1ea735c tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:14.136800 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-3bffe78c-d380-4f54-bfaf-1458894537e6 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:14.146421 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-3bffe78c-d380-4f54-bfaf-1458894537e6 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:14.148928 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-3bffe78c-d380-4f54-bfaf-1458894537e6 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:14.150147 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-3bffe78c-d380-4f54-bfaf-1458894537e6 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a" status: 200 len: 1731 microversion: 2.20 time: 0.568765 Oct 29 01:36:14.150931 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 514/1040] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:36:13 2021] GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a => generated 1731 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:36:14.155538 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-446c6470-4a37-423c-92d2-d04815f7a042 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:14.156172 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-446c6470-4a37-423c-92d2-d04815f7a042 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] [instance: 58f3409d-cd2a-4bef-9ae4-2fba782b321f] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:14.163389 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-446c6470-4a37-423c-92d2-d04815f7a042 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:14.163694 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-446c6470-4a37-423c-92d2-d04815f7a042 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:14.164524 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-446c6470-4a37-423c-92d2-d04815f7a042 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:14.164951 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-446c6470-4a37-423c-92d2-d04815f7a042 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:14.331231 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-9ee92231-806c-47c3-9e35-4d14e1ea735c tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7b600cfde24de9809afe2b55db97cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8778e689b6e42e2b16d49b3fe762ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:14.339975 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-9ee92231-806c-47c3-9e35-4d14e1ea735c tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] 10.222.0.87 "GET /compute/v2.1/servers/e680bc8b-1a56-4a4f-b1aa-fd79a9e98da8" status: 200 len: 1318 microversion: 2.1 time: 0.585110 Oct 29 01:36:14.340546 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 527/1041] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:36:13 2021] GET /compute/v2.1/servers/e680bc8b-1a56-4a4f-b1aa-fd79a9e98da8 => generated 1318 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:36:14.424368 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-446c6470-4a37-423c-92d2-d04815f7a042 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c50a525003e427ba5ff9dea8f4ed47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0db42704249b29fba70abbda7991c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:14.440907 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-446c6470-4a37-423c-92d2-d04815f7a042 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] 10.222.0.87 "GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f" status: 200 len: 1570 microversion: 2.1 time: 0.288982 Oct 29 01:36:14.442071 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 515/1042] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:36:14 2021] GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f => generated 1570 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:36:14.634775 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-76fdc28f-87ac-42aa-8660-3b82ed60c6a5 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:14.635463 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-76fdc28f-87ac-42aa-8660-3b82ed60c6a5 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] [instance: 1faefe62-60e7-43c3-bf58-686598242ea3] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:14.642029 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-76fdc28f-87ac-42aa-8660-3b82ed60c6a5 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:14.642471 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-76fdc28f-87ac-42aa-8660-3b82ed60c6a5 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:14.643239 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-76fdc28f-87ac-42aa-8660-3b82ed60c6a5 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:14.643669 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-76fdc28f-87ac-42aa-8660-3b82ed60c6a5 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:14.772911 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-76fdc28f-87ac-42aa-8660-3b82ed60c6a5 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1147a77b5da48f9a75cefa0ab0e6b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700a9aa6afdf4de6b64d375544d7eb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:14.780900 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-76fdc28f-87ac-42aa-8660-3b82ed60c6a5 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] 10.222.0.87 "GET /compute/v2.1/servers/1faefe62-60e7-43c3-bf58-686598242ea3" status: 200 len: 1757 microversion: 2.1 time: 0.150404 Oct 29 01:36:14.781506 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 528/1043] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:36:14 2021] GET /compute/v2.1/servers/1faefe62-60e7-43c3-bf58-686598242ea3 => generated 1757 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:36:15.168496 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-6f347926-e456-436b-a167-daa30bc933b2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:15.169154 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-6f347926-e456-436b-a167-daa30bc933b2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:15.176505 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-6f347926-e456-436b-a167-daa30bc933b2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:15.176957 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-6f347926-e456-436b-a167-daa30bc933b2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:15.178515 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-6f347926-e456-436b-a167-daa30bc933b2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:15.179084 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-6f347926-e456-436b-a167-daa30bc933b2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:15.308578 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-6f347926-e456-436b-a167-daa30bc933b2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:15.316841 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-6f347926-e456-436b-a167-daa30bc933b2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:15.319094 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-6f347926-e456-436b-a167-daa30bc933b2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:15.320287 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-6f347926-e456-436b-a167-daa30bc933b2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a" status: 200 len: 1718 microversion: 2.20 time: 0.155752 Oct 29 01:36:15.320845 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 516/1044] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:36:15 2021] GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a => generated 1718 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:36:15.356673 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-d9837b18-4d0c-44a4-bd30-8976b9c7d03b tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:15.357266 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-d9837b18-4d0c-44a4-bd30-8976b9c7d03b tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] [instance: e680bc8b-1a56-4a4f-b1aa-fd79a9e98da8] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:15.363185 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-d9837b18-4d0c-44a4-bd30-8976b9c7d03b tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:15.363626 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-d9837b18-4d0c-44a4-bd30-8976b9c7d03b tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:15.364409 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-d9837b18-4d0c-44a4-bd30-8976b9c7d03b tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:15.364837 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-d9837b18-4d0c-44a4-bd30-8976b9c7d03b tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:15.457336 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-87ff1850-1e6b-4a40-9cde-103f497ead2b tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:15.458033 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-87ff1850-1e6b-4a40-9cde-103f497ead2b tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] [instance: 58f3409d-cd2a-4bef-9ae4-2fba782b321f] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:15.464184 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-87ff1850-1e6b-4a40-9cde-103f497ead2b tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:15.464734 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-87ff1850-1e6b-4a40-9cde-103f497ead2b tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:15.465595 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-87ff1850-1e6b-4a40-9cde-103f497ead2b tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:15.466097 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-87ff1850-1e6b-4a40-9cde-103f497ead2b tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:15.489597 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-d9837b18-4d0c-44a4-bd30-8976b9c7d03b tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7b600cfde24de9809afe2b55db97cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8778e689b6e42e2b16d49b3fe762ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:15.497998 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-d9837b18-4d0c-44a4-bd30-8976b9c7d03b tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] 10.222.0.87 "GET /compute/v2.1/servers/e680bc8b-1a56-4a4f-b1aa-fd79a9e98da8" status: 200 len: 1318 microversion: 2.1 time: 0.144859 Oct 29 01:36:15.498574 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 529/1045] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:36:15 2021] GET /compute/v2.1/servers/e680bc8b-1a56-4a4f-b1aa-fd79a9e98da8 => generated 1318 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:36:15.588550 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-87ff1850-1e6b-4a40-9cde-103f497ead2b tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c50a525003e427ba5ff9dea8f4ed47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0db42704249b29fba70abbda7991c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:15.595857 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-87ff1850-1e6b-4a40-9cde-103f497ead2b tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] 10.222.0.87 "GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f" status: 200 len: 1570 microversion: 2.1 time: 0.142390 Oct 29 01:36:15.596476 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 517/1046] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:36:15 2021] GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f => generated 1570 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:36:15.797938 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-de380588-a0b5-4aac-b93b-db2191d99325 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:15.798543 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-de380588-a0b5-4aac-b93b-db2191d99325 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] [instance: 1faefe62-60e7-43c3-bf58-686598242ea3] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:15.805746 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-de380588-a0b5-4aac-b93b-db2191d99325 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:15.806188 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-de380588-a0b5-4aac-b93b-db2191d99325 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:15.806951 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-de380588-a0b5-4aac-b93b-db2191d99325 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:15.807384 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-de380588-a0b5-4aac-b93b-db2191d99325 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:15.938812 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-de380588-a0b5-4aac-b93b-db2191d99325 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1147a77b5da48f9a75cefa0ab0e6b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700a9aa6afdf4de6b64d375544d7eb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:15.946534 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-de380588-a0b5-4aac-b93b-db2191d99325 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] 10.222.0.87 "GET /compute/v2.1/servers/1faefe62-60e7-43c3-bf58-686598242ea3" status: 200 len: 1757 microversion: 2.1 time: 0.152240 Oct 29 01:36:15.947101 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 530/1047] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:36:15 2021] GET /compute/v2.1/servers/1faefe62-60e7-43c3-bf58-686598242ea3 => generated 1757 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:36:16.514890 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-79686f70-a22c-4461-afed-fbf1c69be22d tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:16.515515 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-79686f70-a22c-4461-afed-fbf1c69be22d tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] [instance: e680bc8b-1a56-4a4f-b1aa-fd79a9e98da8] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:16.522703 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-79686f70-a22c-4461-afed-fbf1c69be22d tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:16.523150 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-79686f70-a22c-4461-afed-fbf1c69be22d tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:16.523948 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-79686f70-a22c-4461-afed-fbf1c69be22d tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:16.524383 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-79686f70-a22c-4461-afed-fbf1c69be22d tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:16.614263 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-f1c6c8a1-83ea-4f6b-9ba1-a60675ecda2c tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:16.621746 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-f1c6c8a1-83ea-4f6b-9ba1-a60675ecda2c tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] [instance: 58f3409d-cd2a-4bef-9ae4-2fba782b321f] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:16.622372 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-f1c6c8a1-83ea-4f6b-9ba1-a60675ecda2c tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:16.622816 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-f1c6c8a1-83ea-4f6b-9ba1-a60675ecda2c tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:16.623595 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-f1c6c8a1-83ea-4f6b-9ba1-a60675ecda2c tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:16.624059 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-f1c6c8a1-83ea-4f6b-9ba1-a60675ecda2c tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:16.661856 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-79686f70-a22c-4461-afed-fbf1c69be22d tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7b600cfde24de9809afe2b55db97cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8778e689b6e42e2b16d49b3fe762ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:16.664935 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-79686f70-a22c-4461-afed-fbf1c69be22d tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] 10.222.0.87 "GET /compute/v2.1/servers/e680bc8b-1a56-4a4f-b1aa-fd79a9e98da8" status: 200 len: 1318 microversion: 2.1 time: 0.153711 Oct 29 01:36:16.665512 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 518/1048] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:36:16 2021] GET /compute/v2.1/servers/e680bc8b-1a56-4a4f-b1aa-fd79a9e98da8 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:36:16.761076 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-f1c6c8a1-83ea-4f6b-9ba1-a60675ecda2c tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c50a525003e427ba5ff9dea8f4ed47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0db42704249b29fba70abbda7991c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:16.769651 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-f1c6c8a1-83ea-4f6b-9ba1-a60675ecda2c tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] 10.222.0.87 "GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f" status: 200 len: 1570 microversion: 2.1 time: 0.159208 Oct 29 01:36:16.770318 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 531/1049] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:36:16 2021] GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f => generated 1570 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:36:16.964183 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-02149500-566c-42ce-9c40-48cf51bee801 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:16.964778 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-02149500-566c-42ce-9c40-48cf51bee801 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] [instance: 1faefe62-60e7-43c3-bf58-686598242ea3] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:16.970692 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-02149500-566c-42ce-9c40-48cf51bee801 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:16.971159 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-02149500-566c-42ce-9c40-48cf51bee801 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:16.972056 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-02149500-566c-42ce-9c40-48cf51bee801 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:16.972796 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-02149500-566c-42ce-9c40-48cf51bee801 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:17.126976 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-02149500-566c-42ce-9c40-48cf51bee801 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1147a77b5da48f9a75cefa0ab0e6b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700a9aa6afdf4de6b64d375544d7eb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:17.136329 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-02149500-566c-42ce-9c40-48cf51bee801 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] 10.222.0.87 "GET /compute/v2.1/servers/1faefe62-60e7-43c3-bf58-686598242ea3" status: 200 len: 1757 microversion: 2.1 time: 0.175753 Oct 29 01:36:17.136914 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 519/1050] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:36:16 2021] GET /compute/v2.1/servers/1faefe62-60e7-43c3-bf58-686598242ea3 => generated 1757 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:36:17.684622 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-439e4693-d4a5-4896-8fbf-3c021a4d3130 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:17.685198 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-439e4693-d4a5-4896-8fbf-3c021a4d3130 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] [instance: e680bc8b-1a56-4a4f-b1aa-fd79a9e98da8] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:17.697620 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-439e4693-d4a5-4896-8fbf-3c021a4d3130 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:17.698172 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-439e4693-d4a5-4896-8fbf-3c021a4d3130 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:17.698950 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-439e4693-d4a5-4896-8fbf-3c021a4d3130 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:17.699377 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-439e4693-d4a5-4896-8fbf-3c021a4d3130 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:17.787497 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-4af111dc-c68a-415a-8ef0-dfdda60eef21 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:17.788739 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-4af111dc-c68a-415a-8ef0-dfdda60eef21 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] [instance: 58f3409d-cd2a-4bef-9ae4-2fba782b321f] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:17.795059 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-4af111dc-c68a-415a-8ef0-dfdda60eef21 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:17.795880 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-4af111dc-c68a-415a-8ef0-dfdda60eef21 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:17.796875 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-4af111dc-c68a-415a-8ef0-dfdda60eef21 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:17.797525 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-4af111dc-c68a-415a-8ef0-dfdda60eef21 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:17.828292 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-439e4693-d4a5-4896-8fbf-3c021a4d3130 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7b600cfde24de9809afe2b55db97cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8778e689b6e42e2b16d49b3fe762ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:17.837940 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-439e4693-d4a5-4896-8fbf-3c021a4d3130 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] 10.222.0.87 "GET /compute/v2.1/servers/e680bc8b-1a56-4a4f-b1aa-fd79a9e98da8" status: 200 len: 1318 microversion: 2.1 time: 0.157250 Oct 29 01:36:17.838719 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 532/1051] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:36:17 2021] GET /compute/v2.1/servers/e680bc8b-1a56-4a4f-b1aa-fd79a9e98da8 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:36:17.931694 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-4af111dc-c68a-415a-8ef0-dfdda60eef21 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c50a525003e427ba5ff9dea8f4ed47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0db42704249b29fba70abbda7991c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:17.940544 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-4af111dc-c68a-415a-8ef0-dfdda60eef21 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] 10.222.0.87 "GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f" status: 200 len: 1570 microversion: 2.1 time: 0.157141 Oct 29 01:36:17.941045 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 520/1052] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:36:17 2021] GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:36:18.153344 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-18aab53a-6061-4fda-b32e-1cc9afd0f655 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:18.153944 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-18aab53a-6061-4fda-b32e-1cc9afd0f655 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] [instance: 1faefe62-60e7-43c3-bf58-686598242ea3] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:18.160136 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-18aab53a-6061-4fda-b32e-1cc9afd0f655 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:18.160576 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-18aab53a-6061-4fda-b32e-1cc9afd0f655 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:18.161353 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-18aab53a-6061-4fda-b32e-1cc9afd0f655 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:18.161785 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-18aab53a-6061-4fda-b32e-1cc9afd0f655 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:18.303324 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-18aab53a-6061-4fda-b32e-1cc9afd0f655 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1147a77b5da48f9a75cefa0ab0e6b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700a9aa6afdf4de6b64d375544d7eb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:18.311372 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-18aab53a-6061-4fda-b32e-1cc9afd0f655 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] 10.222.0.87 "GET /compute/v2.1/servers/1faefe62-60e7-43c3-bf58-686598242ea3" status: 200 len: 1757 microversion: 2.1 time: 0.161664 Oct 29 01:36:18.312210 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 533/1053] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:36:18 2021] GET /compute/v2.1/servers/1faefe62-60e7-43c3-bf58-686598242ea3 => generated 1757 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:36:18.855304 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-60694e98-50fa-4fc7-90a2-1d07d867fce9 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:18.855927 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-60694e98-50fa-4fc7-90a2-1d07d867fce9 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] [instance: e680bc8b-1a56-4a4f-b1aa-fd79a9e98da8] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:18.862195 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-60694e98-50fa-4fc7-90a2-1d07d867fce9 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:18.862638 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-60694e98-50fa-4fc7-90a2-1d07d867fce9 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:18.863412 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-60694e98-50fa-4fc7-90a2-1d07d867fce9 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:18.863876 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-60694e98-50fa-4fc7-90a2-1d07d867fce9 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:18.957698 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-0a138565-885b-45bd-86fc-6d7699676044 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:18.958306 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-0a138565-885b-45bd-86fc-6d7699676044 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] [instance: 58f3409d-cd2a-4bef-9ae4-2fba782b321f] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:18.965944 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-0a138565-885b-45bd-86fc-6d7699676044 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:18.966391 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-0a138565-885b-45bd-86fc-6d7699676044 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:18.967171 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-0a138565-885b-45bd-86fc-6d7699676044 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:18.967603 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-0a138565-885b-45bd-86fc-6d7699676044 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:18.994330 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-60694e98-50fa-4fc7-90a2-1d07d867fce9 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7b600cfde24de9809afe2b55db97cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8778e689b6e42e2b16d49b3fe762ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:19.002314 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-60694e98-50fa-4fc7-90a2-1d07d867fce9 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] 10.222.0.87 "GET /compute/v2.1/servers/e680bc8b-1a56-4a4f-b1aa-fd79a9e98da8" status: 200 len: 1318 microversion: 2.1 time: 0.150830 Oct 29 01:36:19.002892 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 521/1054] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:36:18 2021] GET /compute/v2.1/servers/e680bc8b-1a56-4a4f-b1aa-fd79a9e98da8 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:36:19.101287 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-0a138565-885b-45bd-86fc-6d7699676044 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c50a525003e427ba5ff9dea8f4ed47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0db42704249b29fba70abbda7991c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:19.109528 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-0a138565-885b-45bd-86fc-6d7699676044 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] 10.222.0.87 "GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f" status: 200 len: 1570 microversion: 2.1 time: 0.155595 Oct 29 01:36:19.110342 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 534/1055] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:36:18 2021] GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:36:19.330457 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-640de366-30ce-4c9c-aa5f-88b400114d8c tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:19.331214 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-640de366-30ce-4c9c-aa5f-88b400114d8c tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] [instance: 1faefe62-60e7-43c3-bf58-686598242ea3] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:19.337943 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-640de366-30ce-4c9c-aa5f-88b400114d8c tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:19.338560 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-640de366-30ce-4c9c-aa5f-88b400114d8c tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:19.343926 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-640de366-30ce-4c9c-aa5f-88b400114d8c tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:19.343926 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-640de366-30ce-4c9c-aa5f-88b400114d8c tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:19.350261 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [req-497a27f5-8b47-4f5b-8cf8-c0a77b4ca3ce req-1b900040-326e-45fe-be99-22231d926c9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e680bc8b-1a56-4a4f-b1aa-fd79a9e98da8", "name": "network-vif-plugged", "status": "completed", "tag": "4ed04aff-6179-4c33-bfce-b78bc0ab0759"}]} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:36:19.352101 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:36:19.352101 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: warnings.warn(msg) Oct 29 01:36:19.361327 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [req-497a27f5-8b47-4f5b-8cf8-c0a77b4ca3ce req-1b900040-326e-45fe-be99-22231d926c9b service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:19.361692 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [req-497a27f5-8b47-4f5b-8cf8-c0a77b4ca3ce req-1b900040-326e-45fe-be99-22231d926c9b service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:19.373490 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.compute.server_external_events [req-497a27f5-8b47-4f5b-8cf8-c0a77b4ca3ce req-1b900040-326e-45fe-be99-22231d926c9b service nova] Creating event network-vif-plugged:4ed04aff-6179-4c33-bfce-b78bc0ab0759 for instance e680bc8b-1a56-4a4f-b1aa-fd79a9e98da8 on hv-cinder-81398 Oct 29 01:36:19.378940 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [req-497a27f5-8b47-4f5b-8cf8-c0a77b4ca3ce req-1b900040-326e-45fe-be99-22231d926c9b service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033935 Oct 29 01:36:19.379540 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 535/1056] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Oct 29 01:36:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:36:19.493853 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-640de366-30ce-4c9c-aa5f-88b400114d8c tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1147a77b5da48f9a75cefa0ab0e6b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700a9aa6afdf4de6b64d375544d7eb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:19.501962 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-640de366-30ce-4c9c-aa5f-88b400114d8c tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] 10.222.0.87 "GET /compute/v2.1/servers/1faefe62-60e7-43c3-bf58-686598242ea3" status: 200 len: 1760 microversion: 2.1 time: 0.175789 Oct 29 01:36:19.502613 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 522/1057] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:36:19 2021] GET /compute/v2.1/servers/1faefe62-60e7-43c3-bf58-686598242ea3 => generated 1760 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:36:20.020596 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-c171f261-0ce6-406b-80cc-15dc14b5ecad tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:20.021325 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-c171f261-0ce6-406b-80cc-15dc14b5ecad tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] [instance: e680bc8b-1a56-4a4f-b1aa-fd79a9e98da8] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:20.028261 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c171f261-0ce6-406b-80cc-15dc14b5ecad tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:20.028708 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c171f261-0ce6-406b-80cc-15dc14b5ecad tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:20.029477 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c171f261-0ce6-406b-80cc-15dc14b5ecad tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:20.029905 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c171f261-0ce6-406b-80cc-15dc14b5ecad tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:20.127380 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-d949a1b9-39ca-4b45-8043-26438b925756 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:20.128017 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-d949a1b9-39ca-4b45-8043-26438b925756 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] [instance: 58f3409d-cd2a-4bef-9ae4-2fba782b321f] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:20.135645 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d949a1b9-39ca-4b45-8043-26438b925756 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:20.136132 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d949a1b9-39ca-4b45-8043-26438b925756 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:20.136918 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d949a1b9-39ca-4b45-8043-26438b925756 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:20.137346 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d949a1b9-39ca-4b45-8043-26438b925756 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:20.168030 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-c171f261-0ce6-406b-80cc-15dc14b5ecad tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7b600cfde24de9809afe2b55db97cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8778e689b6e42e2b16d49b3fe762ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:20.176299 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-c171f261-0ce6-406b-80cc-15dc14b5ecad tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] 10.222.0.87 "GET /compute/v2.1/servers/e680bc8b-1a56-4a4f-b1aa-fd79a9e98da8" status: 200 len: 1318 microversion: 2.1 time: 0.159553 Oct 29 01:36:20.176892 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 536/1058] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:36:20 2021] GET /compute/v2.1/servers/e680bc8b-1a56-4a4f-b1aa-fd79a9e98da8 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:36:20.272794 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-d949a1b9-39ca-4b45-8043-26438b925756 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c50a525003e427ba5ff9dea8f4ed47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0db42704249b29fba70abbda7991c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:20.281122 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-d949a1b9-39ca-4b45-8043-26438b925756 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] 10.222.0.87 "GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f" status: 200 len: 1570 microversion: 2.1 time: 0.157324 Oct 29 01:36:20.281689 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 523/1059] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:36:20 2021] GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:36:21.194232 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-ee7c6c67-1fc2-43e9-9b83-698cff46a394 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:21.195074 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-ee7c6c67-1fc2-43e9-9b83-698cff46a394 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] [instance: e680bc8b-1a56-4a4f-b1aa-fd79a9e98da8] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:21.201376 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ee7c6c67-1fc2-43e9-9b83-698cff46a394 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:21.201821 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ee7c6c67-1fc2-43e9-9b83-698cff46a394 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:21.202636 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ee7c6c67-1fc2-43e9-9b83-698cff46a394 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:21.203061 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ee7c6c67-1fc2-43e9-9b83-698cff46a394 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:21.299334 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-1bcde373-3e96-4ddd-b4ea-b51359239771 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:21.300062 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-1bcde373-3e96-4ddd-b4ea-b51359239771 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] [instance: 58f3409d-cd2a-4bef-9ae4-2fba782b321f] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:21.307881 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-1bcde373-3e96-4ddd-b4ea-b51359239771 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:21.313517 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-1bcde373-3e96-4ddd-b4ea-b51359239771 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:21.313517 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-1bcde373-3e96-4ddd-b4ea-b51359239771 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:21.313517 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-1bcde373-3e96-4ddd-b4ea-b51359239771 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:21.340126 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-ee7c6c67-1fc2-43e9-9b83-698cff46a394 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7b600cfde24de9809afe2b55db97cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8778e689b6e42e2b16d49b3fe762ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:21.348479 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-ee7c6c67-1fc2-43e9-9b83-698cff46a394 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] 10.222.0.87 "GET /compute/v2.1/servers/e680bc8b-1a56-4a4f-b1aa-fd79a9e98da8" status: 200 len: 1318 microversion: 2.1 time: 0.158262 Oct 29 01:36:21.357922 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 537/1060] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:36:21 2021] GET /compute/v2.1/servers/e680bc8b-1a56-4a4f-b1aa-fd79a9e98da8 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:36:21.457692 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-1bcde373-3e96-4ddd-b4ea-b51359239771 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c50a525003e427ba5ff9dea8f4ed47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0db42704249b29fba70abbda7991c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:21.467989 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-1bcde373-3e96-4ddd-b4ea-b51359239771 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] 10.222.0.87 "GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f" status: 200 len: 1570 microversion: 2.1 time: 0.171139 Oct 29 01:36:21.467989 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 524/1061] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:36:21 2021] GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f => generated 1570 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:36:22.366402 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-2a6302a6-206f-4e18-9e17-9906ba2d598d tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:22.368054 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-2a6302a6-206f-4e18-9e17-9906ba2d598d tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] [instance: e680bc8b-1a56-4a4f-b1aa-fd79a9e98da8] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:22.373468 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-2a6302a6-206f-4e18-9e17-9906ba2d598d tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:22.374000 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-2a6302a6-206f-4e18-9e17-9906ba2d598d tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:22.374779 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-2a6302a6-206f-4e18-9e17-9906ba2d598d tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:22.375240 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-2a6302a6-206f-4e18-9e17-9906ba2d598d tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:22.486383 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-433ca06f-acac-44a4-8b5c-aa4f63502253 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:22.486927 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-433ca06f-acac-44a4-8b5c-aa4f63502253 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] [instance: 58f3409d-cd2a-4bef-9ae4-2fba782b321f] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:22.494419 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-433ca06f-acac-44a4-8b5c-aa4f63502253 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:22.494866 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-433ca06f-acac-44a4-8b5c-aa4f63502253 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:22.495656 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-433ca06f-acac-44a4-8b5c-aa4f63502253 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:22.496125 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-433ca06f-acac-44a4-8b5c-aa4f63502253 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:22.504744 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-2a6302a6-206f-4e18-9e17-9906ba2d598d tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7b600cfde24de9809afe2b55db97cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8778e689b6e42e2b16d49b3fe762ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:22.513208 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-2a6302a6-206f-4e18-9e17-9906ba2d598d tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] 10.222.0.87 "GET /compute/v2.1/servers/e680bc8b-1a56-4a4f-b1aa-fd79a9e98da8" status: 200 len: 1509 microversion: 2.1 time: 0.151289 Oct 29 01:36:22.519781 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 538/1062] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:36:22 2021] GET /compute/v2.1/servers/e680bc8b-1a56-4a4f-b1aa-fd79a9e98da8 => generated 1509 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:36:22.635782 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-433ca06f-acac-44a4-8b5c-aa4f63502253 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c50a525003e427ba5ff9dea8f4ed47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0db42704249b29fba70abbda7991c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:22.643535 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-433ca06f-acac-44a4-8b5c-aa4f63502253 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] 10.222.0.87 "GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f" status: 200 len: 1571 microversion: 2.1 time: 0.161601 Oct 29 01:36:22.644351 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 525/1063] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:36:22 2021] GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f => generated 1571 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:36:22.660624 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-5aafa608-7cd8-40fc-b17b-85f049e19847 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:36:22.661334 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-5aafa608-7cd8-40fc-b17b-85f049e19847 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] [instance: 58f3409d-cd2a-4bef-9ae4-2fba782b321f] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:22.668925 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-5aafa608-7cd8-40fc-b17b-85f049e19847 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:22.669370 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-5aafa608-7cd8-40fc-b17b-85f049e19847 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:22.670130 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-5aafa608-7cd8-40fc-b17b-85f049e19847 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:22.670557 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-5aafa608-7cd8-40fc-b17b-85f049e19847 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:22.995815 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-5aafa608-7cd8-40fc-b17b-85f049e19847 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] 10.222.0.87 "POST /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f/action" status: 202 len: 0 microversion: 2.1 time: 0.338770 Oct 29 01:36:22.996662 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 539/1064] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:36:22 2021] POST /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f/action => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:36:23.014523 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-4272a41e-fb5f-406a-9840-913ea9336df1 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:23.015133 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-4272a41e-fb5f-406a-9840-913ea9336df1 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] [instance: 58f3409d-cd2a-4bef-9ae4-2fba782b321f] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:23.022957 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-4272a41e-fb5f-406a-9840-913ea9336df1 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:23.023405 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-4272a41e-fb5f-406a-9840-913ea9336df1 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:23.024215 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-4272a41e-fb5f-406a-9840-913ea9336df1 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:23.025230 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-4272a41e-fb5f-406a-9840-913ea9336df1 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:23.186664 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-4272a41e-fb5f-406a-9840-913ea9336df1 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c50a525003e427ba5ff9dea8f4ed47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0db42704249b29fba70abbda7991c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:23.196095 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-4272a41e-fb5f-406a-9840-913ea9336df1 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] 10.222.0.87 "GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f" status: 200 len: 1579 microversion: 2.1 time: 0.192628 Oct 29 01:36:23.196706 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 526/1065] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:36:23 2021] GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f => generated 1579 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:36:24.214188 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-afd377fd-2c8a-42a9-b571-87c618973d2a tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:24.214837 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-afd377fd-2c8a-42a9-b571-87c618973d2a tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] [instance: 58f3409d-cd2a-4bef-9ae4-2fba782b321f] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:24.222409 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-afd377fd-2c8a-42a9-b571-87c618973d2a tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:24.222892 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-afd377fd-2c8a-42a9-b571-87c618973d2a tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:24.223669 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-afd377fd-2c8a-42a9-b571-87c618973d2a tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:24.224155 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-afd377fd-2c8a-42a9-b571-87c618973d2a tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:24.358296 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-afd377fd-2c8a-42a9-b571-87c618973d2a tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c50a525003e427ba5ff9dea8f4ed47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0db42704249b29fba70abbda7991c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:24.368646 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-afd377fd-2c8a-42a9-b571-87c618973d2a tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] 10.222.0.87 "GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f" status: 200 len: 1521 microversion: 2.1 time: 0.158206 Oct 29 01:36:24.373258 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 540/1066] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:36:24 2021] GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:36:24.392570 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-035574d4-1a04-4ca0-9920-21858733ba98 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5903e5eb-ff4d-42f9-a16d-eff9b958e779"}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:36:24.393627 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-035574d4-1a04-4ca0-9920-21858733ba98 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] [instance: e680bc8b-1a56-4a4f-b1aa-fd79a9e98da8] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:24.403053 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-035574d4-1a04-4ca0-9920-21858733ba98 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:24.407931 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-035574d4-1a04-4ca0-9920-21858733ba98 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:24.407931 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-035574d4-1a04-4ca0-9920-21858733ba98 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:24.407931 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-035574d4-1a04-4ca0-9920-21858733ba98 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:25.202091 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-035574d4-1a04-4ca0-9920-21858733ba98 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] 10.222.0.87 "POST /compute/v2.1/servers/e680bc8b-1a56-4a4f-b1aa-fd79a9e98da8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.812751 Oct 29 01:36:25.203110 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 527/1067] 10.222.0.87 () {60 vars in 1322 bytes} [Fri Oct 29 01:36:24 2021] POST /compute/v2.1/servers/e680bc8b-1a56-4a4f-b1aa-fd79a9e98da8/os-volume_attachments => generated 194 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:36:25.255411 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [req-e2a7baee-cf40-4790-9d0e-97661d866aa6 req-b112d102-aa18-48e4-a23a-126fbabdca63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58f3409d-cd2a-4bef-9ae4-2fba782b321f", "name": "network-vif-unplugged", "status": "completed", "tag": "b9061b77-a5c8-4ac6-9f65-0f8712ee20cf"}]} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:36:25.260524 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:36:25.260524 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: warnings.warn(msg) Oct 29 01:36:25.273449 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [req-e2a7baee-cf40-4790-9d0e-97661d866aa6 req-b112d102-aa18-48e4-a23a-126fbabdca63 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:25.275418 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [req-e2a7baee-cf40-4790-9d0e-97661d866aa6 req-b112d102-aa18-48e4-a23a-126fbabdca63 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:25.295427 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.compute.server_external_events [req-e2a7baee-cf40-4790-9d0e-97661d866aa6 req-b112d102-aa18-48e4-a23a-126fbabdca63 service nova] Unable to find a host for instance 58f3409d-cd2a-4bef-9ae4-2fba782b321f. Dropping event network-vif-unplugged {{(pid=116378) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Oct 29 01:36:25.296489 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [req-e2a7baee-cf40-4790-9d0e-97661d866aa6 req-b112d102-aa18-48e4-a23a-126fbabdca63 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.053843 Oct 29 01:36:25.297197 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 541/1068] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Oct 29 01:36:25 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 55 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 29 01:36:25.387281 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-821f9daf-822d-432a-98a9-d172ce2a83aa tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:25.388036 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-821f9daf-822d-432a-98a9-d172ce2a83aa tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] [instance: 58f3409d-cd2a-4bef-9ae4-2fba782b321f] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:25.394403 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-821f9daf-822d-432a-98a9-d172ce2a83aa tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:25.395007 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-821f9daf-822d-432a-98a9-d172ce2a83aa tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:25.395721 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-821f9daf-822d-432a-98a9-d172ce2a83aa tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:25.396254 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-821f9daf-822d-432a-98a9-d172ce2a83aa tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:25.575959 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-821f9daf-822d-432a-98a9-d172ce2a83aa tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c50a525003e427ba5ff9dea8f4ed47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0db42704249b29fba70abbda7991c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:25.584323 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-821f9daf-822d-432a-98a9-d172ce2a83aa tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] 10.222.0.87 "GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f" status: 200 len: 1521 microversion: 2.1 time: 0.201008 Oct 29 01:36:25.585613 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 528/1069] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:36:25 2021] GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:36:26.602856 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-7f9575ae-7b0a-4806-8851-870d9b2cd998 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:26.603447 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-7f9575ae-7b0a-4806-8851-870d9b2cd998 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] [instance: 58f3409d-cd2a-4bef-9ae4-2fba782b321f] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:26.609817 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-7f9575ae-7b0a-4806-8851-870d9b2cd998 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:26.610264 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-7f9575ae-7b0a-4806-8851-870d9b2cd998 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:26.611049 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-7f9575ae-7b0a-4806-8851-870d9b2cd998 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:26.611480 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-7f9575ae-7b0a-4806-8851-870d9b2cd998 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:26.736839 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-7f9575ae-7b0a-4806-8851-870d9b2cd998 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c50a525003e427ba5ff9dea8f4ed47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0db42704249b29fba70abbda7991c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:26.745074 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-7f9575ae-7b0a-4806-8851-870d9b2cd998 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] 10.222.0.87 "GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f" status: 200 len: 1577 microversion: 2.1 time: 0.146543 Oct 29 01:36:26.745638 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 542/1070] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:36:26 2021] GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f => generated 1577 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:36:27.762756 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-fe76c823-2ced-4bf9-ae81-f9bb5aba538c tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:27.763288 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-fe76c823-2ced-4bf9-ae81-f9bb5aba538c tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] [instance: 58f3409d-cd2a-4bef-9ae4-2fba782b321f] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:27.769595 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-fe76c823-2ced-4bf9-ae81-f9bb5aba538c tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:27.770034 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-fe76c823-2ced-4bf9-ae81-f9bb5aba538c tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:27.770792 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-fe76c823-2ced-4bf9-ae81-f9bb5aba538c tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:27.771216 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-fe76c823-2ced-4bf9-ae81-f9bb5aba538c tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:27.890921 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-fe76c823-2ced-4bf9-ae81-f9bb5aba538c tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c50a525003e427ba5ff9dea8f4ed47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0db42704249b29fba70abbda7991c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:27.898927 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-fe76c823-2ced-4bf9-ae81-f9bb5aba538c tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] 10.222.0.87 "GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f" status: 200 len: 1577 microversion: 2.1 time: 0.139890 Oct 29 01:36:27.899495 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 529/1071] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:36:27 2021] GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f => generated 1577 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:36:28.916449 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-35a5a4d1-c615-4603-812d-376f13e61b9c tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:28.917043 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-35a5a4d1-c615-4603-812d-376f13e61b9c tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] [instance: 58f3409d-cd2a-4bef-9ae4-2fba782b321f] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:28.923463 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-35a5a4d1-c615-4603-812d-376f13e61b9c tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:28.923941 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-35a5a4d1-c615-4603-812d-376f13e61b9c tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:28.924721 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-35a5a4d1-c615-4603-812d-376f13e61b9c tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:28.925165 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-35a5a4d1-c615-4603-812d-376f13e61b9c tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:29.054137 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-35a5a4d1-c615-4603-812d-376f13e61b9c tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c50a525003e427ba5ff9dea8f4ed47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0db42704249b29fba70abbda7991c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:29.061353 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-35a5a4d1-c615-4603-812d-376f13e61b9c tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] 10.222.0.87 "GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f" status: 200 len: 1577 microversion: 2.1 time: 0.148594 Oct 29 01:36:29.061925 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 543/1072] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:36:28 2021] GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f => generated 1577 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:36:30.078444 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-a2088bec-e457-44b8-b253-4af190732419 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:30.079031 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-a2088bec-e457-44b8-b253-4af190732419 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] [instance: 58f3409d-cd2a-4bef-9ae4-2fba782b321f] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:30.086903 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-a2088bec-e457-44b8-b253-4af190732419 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:30.087359 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-a2088bec-e457-44b8-b253-4af190732419 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:30.088211 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-a2088bec-e457-44b8-b253-4af190732419 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:30.088641 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-a2088bec-e457-44b8-b253-4af190732419 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:30.218873 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-a2088bec-e457-44b8-b253-4af190732419 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c50a525003e427ba5ff9dea8f4ed47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0db42704249b29fba70abbda7991c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:30.227650 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-a2088bec-e457-44b8-b253-4af190732419 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] 10.222.0.87 "GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f" status: 200 len: 1577 microversion: 2.1 time: 0.152896 Oct 29 01:36:30.228269 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 530/1073] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:36:30 2021] GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f => generated 1577 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:36:31.244692 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-2a4db2e4-95ac-44ea-bc5c-e7427d344b2d tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:31.245246 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-2a4db2e4-95ac-44ea-bc5c-e7427d344b2d tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] [instance: 58f3409d-cd2a-4bef-9ae4-2fba782b321f] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:31.251559 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-2a4db2e4-95ac-44ea-bc5c-e7427d344b2d tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:31.252035 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-2a4db2e4-95ac-44ea-bc5c-e7427d344b2d tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:31.252807 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-2a4db2e4-95ac-44ea-bc5c-e7427d344b2d tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:31.258096 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-2a4db2e4-95ac-44ea-bc5c-e7427d344b2d tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:31.384407 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-2a4db2e4-95ac-44ea-bc5c-e7427d344b2d tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c50a525003e427ba5ff9dea8f4ed47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0db42704249b29fba70abbda7991c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:31.392163 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-2a4db2e4-95ac-44ea-bc5c-e7427d344b2d tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] 10.222.0.87 "GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f" status: 200 len: 1577 microversion: 2.1 time: 0.151209 Oct 29 01:36:31.392751 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 544/1074] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:36:31 2021] GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f => generated 1577 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:36:32.410118 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-90b59631-ab15-43f2-ac31-d05e4234bd38 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:32.410726 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-90b59631-ab15-43f2-ac31-d05e4234bd38 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] [instance: 58f3409d-cd2a-4bef-9ae4-2fba782b321f] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:32.417328 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-90b59631-ab15-43f2-ac31-d05e4234bd38 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:32.417786 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-90b59631-ab15-43f2-ac31-d05e4234bd38 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:32.418613 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-90b59631-ab15-43f2-ac31-d05e4234bd38 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:32.419019 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-90b59631-ab15-43f2-ac31-d05e4234bd38 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:32.547150 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-90b59631-ab15-43f2-ac31-d05e4234bd38 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c50a525003e427ba5ff9dea8f4ed47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0db42704249b29fba70abbda7991c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:32.556905 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-90b59631-ab15-43f2-ac31-d05e4234bd38 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] 10.222.0.87 "GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f" status: 200 len: 1577 microversion: 2.1 time: 0.150344 Oct 29 01:36:32.557572 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 531/1075] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:36:32 2021] GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f => generated 1577 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:36:32.787645 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-33e7c35a-ac4f-41ac-8538-b00b270e131e tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1222881109", "imageRef": "3b1d5dc6-2b04-4433-9a93-1db6a740092b", "flavorRef": "452", "networks": [{"uuid": "55f0bc8e-67fb-4207-a774-2feb6c3222d3"}]}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:36:32.841789 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.network.neutron [None req-33e7c35a-ac4f-41ac-8538-b00b270e131e tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] validate_networks() for [('55f0bc8e-67fb-4207-a774-2feb6c3222d3', None, None, None, None, None)] {{(pid=116378) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 29 01:36:33.227324 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.virt.hardware [None req-33e7c35a-ac4f-41ac-8538-b00b270e131e tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Flavor limits 0:0:0 {{(pid=116378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:36:33.227844 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.virt.hardware [None req-33e7c35a-ac4f-41ac-8538-b00b270e131e tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Image limits 0:0:0 {{(pid=116378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:36:33.228378 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.virt.hardware [None req-33e7c35a-ac4f-41ac-8538-b00b270e131e tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Flavor pref 0:0:0 {{(pid=116378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:36:33.229016 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.virt.hardware [None req-33e7c35a-ac4f-41ac-8538-b00b270e131e tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Image pref 0:0:0 {{(pid=116378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:36:33.229495 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.virt.hardware [None req-33e7c35a-ac4f-41ac-8538-b00b270e131e tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:36:33.238413 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-33e7c35a-ac4f-41ac-8538-b00b270e131e tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:33.238857 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-33e7c35a-ac4f-41ac-8538-b00b270e131e tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:33.239657 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-33e7c35a-ac4f-41ac-8538-b00b270e131e tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:33.240124 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-33e7c35a-ac4f-41ac-8538-b00b270e131e tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:33.258323 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.quota [None req-33e7c35a-ac4f-41ac-8538-b00b270e131e tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Getting quotas for project b8778e689b6e42e2b16d49b3fe762ac6. Resources: {'instances', 'cores', 'ram'} {{(pid=116378) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 01:36:33.262727 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.quota [None req-33e7c35a-ac4f-41ac-8538-b00b270e131e tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Getting quotas for user 3c7b600cfde24de9809afe2b55db97cf and project b8778e689b6e42e2b16d49b3fe762ac6. Resources: {'instances', 'cores', 'ram'} {{(pid=116378) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 01:36:33.275535 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-33e7c35a-ac4f-41ac-8538-b00b270e131e tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Going to run 1 instances... {{(pid=116378) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 29 01:36:33.277900 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-33e7c35a-ac4f-41ac-8538-b00b270e131e tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] [instance: bb92bdbd-28c2-4c34-9bc2-78bb5165c567] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3b1d5dc6-2b04-4433-9a93-1db6a740092b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116378) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 29 01:36:33.430822 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-33e7c35a-ac4f-41ac-8538-b00b270e131e tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.646995 Oct 29 01:36:33.431477 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 545/1076] 10.222.0.87 () {60 vars in 1146 bytes} [Fri Oct 29 01:36:32 2021] POST /compute/v2.1/servers => generated 380 bytes in 648 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:36:33.441397 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-36a8c2a1-5c07-4a55-a7b6-aaefe9c80163 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:33.445288 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-36a8c2a1-5c07-4a55-a7b6-aaefe9c80163 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] [instance: bb92bdbd-28c2-4c34-9bc2-78bb5165c567] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:33.499234 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-36a8c2a1-5c07-4a55-a7b6-aaefe9c80163 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7b600cfde24de9809afe2b55db97cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8778e689b6e42e2b16d49b3fe762ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:33.507106 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-36a8c2a1-5c07-4a55-a7b6-aaefe9c80163 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] 10.222.0.87 "GET /compute/v2.1/servers/bb92bdbd-28c2-4c34-9bc2-78bb5165c567" status: 200 len: 1218 microversion: 2.1 time: 0.068687 Oct 29 01:36:33.507915 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 532/1077] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:36:33 2021] GET /compute/v2.1/servers/bb92bdbd-28c2-4c34-9bc2-78bb5165c567 => generated 1218 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:36:33.574452 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-700e9f4d-aaa8-4f94-bc68-0c87c485cd72 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:33.575051 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-700e9f4d-aaa8-4f94-bc68-0c87c485cd72 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] [instance: 58f3409d-cd2a-4bef-9ae4-2fba782b321f] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:33.581606 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-700e9f4d-aaa8-4f94-bc68-0c87c485cd72 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:33.582055 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-700e9f4d-aaa8-4f94-bc68-0c87c485cd72 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:33.582848 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-700e9f4d-aaa8-4f94-bc68-0c87c485cd72 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:33.583275 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-700e9f4d-aaa8-4f94-bc68-0c87c485cd72 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:33.710675 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-700e9f4d-aaa8-4f94-bc68-0c87c485cd72 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c50a525003e427ba5ff9dea8f4ed47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0db42704249b29fba70abbda7991c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:33.718084 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-700e9f4d-aaa8-4f94-bc68-0c87c485cd72 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] 10.222.0.87 "GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f" status: 200 len: 1577 microversion: 2.1 time: 0.147258 Oct 29 01:36:33.718660 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 546/1078] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:36:33 2021] GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f => generated 1577 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:36:34.523766 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-265e44f0-ffcd-42ef-927b-276c4ec9bbfe tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:34.524468 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-265e44f0-ffcd-42ef-927b-276c4ec9bbfe tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] [instance: bb92bdbd-28c2-4c34-9bc2-78bb5165c567] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:34.533292 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-265e44f0-ffcd-42ef-927b-276c4ec9bbfe tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:34.534202 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-265e44f0-ffcd-42ef-927b-276c4ec9bbfe tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:34.535271 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-265e44f0-ffcd-42ef-927b-276c4ec9bbfe tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:34.536380 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-265e44f0-ffcd-42ef-927b-276c4ec9bbfe tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:34.604597 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-265e44f0-ffcd-42ef-927b-276c4ec9bbfe tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7b600cfde24de9809afe2b55db97cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8778e689b6e42e2b16d49b3fe762ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:34.611928 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-265e44f0-ffcd-42ef-927b-276c4ec9bbfe tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] 10.222.0.87 "GET /compute/v2.1/servers/bb92bdbd-28c2-4c34-9bc2-78bb5165c567" status: 200 len: 1214 microversion: 2.1 time: 0.092440 Oct 29 01:36:34.612511 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 533/1079] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:36:34 2021] GET /compute/v2.1/servers/bb92bdbd-28c2-4c34-9bc2-78bb5165c567 => generated 1214 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:36:34.734692 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-1a7edd05-68e9-4329-97ad-79631216a39a tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:34.735482 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-1a7edd05-68e9-4329-97ad-79631216a39a tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] [instance: 58f3409d-cd2a-4bef-9ae4-2fba782b321f] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:34.749224 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-1a7edd05-68e9-4329-97ad-79631216a39a tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:34.749224 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-1a7edd05-68e9-4329-97ad-79631216a39a tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:34.749224 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-1a7edd05-68e9-4329-97ad-79631216a39a tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:34.749224 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-1a7edd05-68e9-4329-97ad-79631216a39a tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:34.852388 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-a2547d3f-c98a-4cf3-a758-74bda38f14b6 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:34.852937 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-a2547d3f-c98a-4cf3-a758-74bda38f14b6 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] [instance: f69664c9-6a0c-4807-a429-f39a1823f6ac] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:34.858959 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-a2547d3f-c98a-4cf3-a758-74bda38f14b6 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:34.859402 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-a2547d3f-c98a-4cf3-a758-74bda38f14b6 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:34.860215 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-a2547d3f-c98a-4cf3-a758-74bda38f14b6 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:34.860643 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-a2547d3f-c98a-4cf3-a758-74bda38f14b6 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:34.870506 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-1a7edd05-68e9-4329-97ad-79631216a39a tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c50a525003e427ba5ff9dea8f4ed47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0db42704249b29fba70abbda7991c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:34.882841 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-1a7edd05-68e9-4329-97ad-79631216a39a tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] 10.222.0.87 "GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f" status: 200 len: 1577 microversion: 2.1 time: 0.151779 Oct 29 01:36:34.887795 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 547/1080] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:36:34 2021] GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f => generated 1577 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:36:34.887955 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-a2547d3f-c98a-4cf3-a758-74bda38f14b6 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] [instance: f69664c9-6a0c-4807-a429-f39a1823f6ac] Going to try to terminate instance {{(pid=116379) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 29 01:36:35.183389 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-a2547d3f-c98a-4cf3-a758-74bda38f14b6 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] 10.222.0.87 "DELETE /compute/v2.1/servers/f69664c9-6a0c-4807-a429-f39a1823f6ac" status: 204 len: 0 microversion: 2.1 time: 0.334808 Oct 29 01:36:35.184036 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 534/1081] 10.222.0.87 () {58 vars in 1238 bytes} [Fri Oct 29 01:36:34 2021] DELETE /compute/v2.1/servers/f69664c9-6a0c-4807-a429-f39a1823f6ac => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 01:36:35.199374 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-43a8d5ab-d768-4b7a-80b6-2388dd844b70 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:35.200356 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-43a8d5ab-d768-4b7a-80b6-2388dd844b70 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] [instance: f69664c9-6a0c-4807-a429-f39a1823f6ac] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:35.206782 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-43a8d5ab-d768-4b7a-80b6-2388dd844b70 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:35.207255 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-43a8d5ab-d768-4b7a-80b6-2388dd844b70 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:35.208116 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-43a8d5ab-d768-4b7a-80b6-2388dd844b70 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:35.208584 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-43a8d5ab-d768-4b7a-80b6-2388dd844b70 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:35.336803 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [req-d539a22f-35b6-438f-ae45-c651219cbf2f req-5bc88522-80d5-4a18-8c64-f2bd754f2a49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58f3409d-cd2a-4bef-9ae4-2fba782b321f", "name": "network-vif-plugged", "status": "completed", "tag": "b9061b77-a5c8-4ac6-9f65-0f8712ee20cf"}]} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:36:35.340641 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:36:35.340641 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: warnings.warn(msg) Oct 29 01:36:35.342443 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-43a8d5ab-d768-4b7a-80b6-2388dd844b70 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef8571ef39b4efe8f510a28052e2b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84bceeeb4f67456a90779360ffc620aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:35.351205 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-43a8d5ab-d768-4b7a-80b6-2388dd844b70 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] 10.222.0.87 "GET /compute/v2.1/servers/f69664c9-6a0c-4807-a429-f39a1823f6ac" status: 200 len: 1577 microversion: 2.1 time: 0.155524 Oct 29 01:36:35.351823 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 548/1082] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:36:35 2021] GET /compute/v2.1/servers/f69664c9-6a0c-4807-a429-f39a1823f6ac => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:36:35.352681 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [req-d539a22f-35b6-438f-ae45-c651219cbf2f req-5bc88522-80d5-4a18-8c64-f2bd754f2a49 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:35.353108 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [req-d539a22f-35b6-438f-ae45-c651219cbf2f req-5bc88522-80d5-4a18-8c64-f2bd754f2a49 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:35.364684 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.compute.server_external_events [req-d539a22f-35b6-438f-ae45-c651219cbf2f req-5bc88522-80d5-4a18-8c64-f2bd754f2a49 service nova] Creating event network-vif-plugged:b9061b77-a5c8-4ac6-9f65-0f8712ee20cf for instance 58f3409d-cd2a-4bef-9ae4-2fba782b321f on hv-cinder-81398 Oct 29 01:36:35.370081 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [req-d539a22f-35b6-438f-ae45-c651219cbf2f req-5bc88522-80d5-4a18-8c64-f2bd754f2a49 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037607 Oct 29 01:36:35.372584 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 535/1083] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Oct 29 01:36:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:36:35.629216 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-a9e93af4-edea-4c77-90a0-f051ef9f2121 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:35.629993 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-a9e93af4-edea-4c77-90a0-f051ef9f2121 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] [instance: bb92bdbd-28c2-4c34-9bc2-78bb5165c567] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:35.637812 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a9e93af4-edea-4c77-90a0-f051ef9f2121 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:35.638363 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a9e93af4-edea-4c77-90a0-f051ef9f2121 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:35.639215 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a9e93af4-edea-4c77-90a0-f051ef9f2121 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:35.639780 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a9e93af4-edea-4c77-90a0-f051ef9f2121 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:35.703390 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-a9e93af4-edea-4c77-90a0-f051ef9f2121 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7b600cfde24de9809afe2b55db97cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8778e689b6e42e2b16d49b3fe762ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:35.712216 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-a9e93af4-edea-4c77-90a0-f051ef9f2121 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] 10.222.0.87 "GET /compute/v2.1/servers/bb92bdbd-28c2-4c34-9bc2-78bb5165c567" status: 200 len: 1278 microversion: 2.1 time: 0.087143 Oct 29 01:36:35.712793 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 549/1084] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:36:35 2021] GET /compute/v2.1/servers/bb92bdbd-28c2-4c34-9bc2-78bb5165c567 => generated 1278 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:36:35.901429 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-20ad10a4-4ab3-44c2-9636-c2055b1d6669 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:35.902135 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-20ad10a4-4ab3-44c2-9636-c2055b1d6669 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] [instance: 58f3409d-cd2a-4bef-9ae4-2fba782b321f] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:35.909145 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-20ad10a4-4ab3-44c2-9636-c2055b1d6669 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:35.909601 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-20ad10a4-4ab3-44c2-9636-c2055b1d6669 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:35.910615 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-20ad10a4-4ab3-44c2-9636-c2055b1d6669 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:35.911052 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-20ad10a4-4ab3-44c2-9636-c2055b1d6669 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:36.103509 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-20ad10a4-4ab3-44c2-9636-c2055b1d6669 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c50a525003e427ba5ff9dea8f4ed47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0db42704249b29fba70abbda7991c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:36.110923 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-20ad10a4-4ab3-44c2-9636-c2055b1d6669 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] 10.222.0.87 "GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f" status: 200 len: 1577 microversion: 2.1 time: 0.214544 Oct 29 01:36:36.111517 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 536/1085] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:36:35 2021] GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f => generated 1577 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:36:36.369945 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-47f7970d-995e-4b00-bda5-29ddefa40ff1 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:36.370541 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-47f7970d-995e-4b00-bda5-29ddefa40ff1 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] [instance: f69664c9-6a0c-4807-a429-f39a1823f6ac] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:36.376990 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-47f7970d-995e-4b00-bda5-29ddefa40ff1 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:36.377464 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-47f7970d-995e-4b00-bda5-29ddefa40ff1 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:36.378293 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-47f7970d-995e-4b00-bda5-29ddefa40ff1 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:36.378718 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-47f7970d-995e-4b00-bda5-29ddefa40ff1 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:36.518784 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-47f7970d-995e-4b00-bda5-29ddefa40ff1 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef8571ef39b4efe8f510a28052e2b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84bceeeb4f67456a90779360ffc620aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:36.527315 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-47f7970d-995e-4b00-bda5-29ddefa40ff1 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] 10.222.0.87 "GET /compute/v2.1/servers/f69664c9-6a0c-4807-a429-f39a1823f6ac" status: 200 len: 1577 microversion: 2.1 time: 0.161859 Oct 29 01:36:36.528303 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 550/1086] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:36:36 2021] GET /compute/v2.1/servers/f69664c9-6a0c-4807-a429-f39a1823f6ac => generated 1577 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:36:36.729823 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-12dea33b-b252-4c88-b48a-dae186c8a615 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:36.730510 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-12dea33b-b252-4c88-b48a-dae186c8a615 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] [instance: bb92bdbd-28c2-4c34-9bc2-78bb5165c567] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:36.736822 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-12dea33b-b252-4c88-b48a-dae186c8a615 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:36.737295 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-12dea33b-b252-4c88-b48a-dae186c8a615 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:36.738124 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-12dea33b-b252-4c88-b48a-dae186c8a615 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:36.738594 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-12dea33b-b252-4c88-b48a-dae186c8a615 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:36.869551 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-12dea33b-b252-4c88-b48a-dae186c8a615 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7b600cfde24de9809afe2b55db97cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8778e689b6e42e2b16d49b3fe762ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:36.878920 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-12dea33b-b252-4c88-b48a-dae186c8a615 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] 10.222.0.87 "GET /compute/v2.1/servers/bb92bdbd-28c2-4c34-9bc2-78bb5165c567" status: 200 len: 1318 microversion: 2.1 time: 0.153082 Oct 29 01:36:36.879545 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 537/1087] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:36:36 2021] GET /compute/v2.1/servers/bb92bdbd-28c2-4c34-9bc2-78bb5165c567 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:36:37.127338 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-85c4cdf6-3411-43a1-8862-0b1ac95ebcaf tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:37.127958 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-85c4cdf6-3411-43a1-8862-0b1ac95ebcaf tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] [instance: 58f3409d-cd2a-4bef-9ae4-2fba782b321f] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:37.133987 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-85c4cdf6-3411-43a1-8862-0b1ac95ebcaf tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:37.134423 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-85c4cdf6-3411-43a1-8862-0b1ac95ebcaf tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:37.135227 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-85c4cdf6-3411-43a1-8862-0b1ac95ebcaf tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:37.135651 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-85c4cdf6-3411-43a1-8862-0b1ac95ebcaf tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:37.217872 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [req-c4acd3dd-2a47-46c1-8261-87e6d7ba4478 req-9a611e20-780b-4560-a9b1-cc1bd2a7d050 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb92bdbd-28c2-4c34-9bc2-78bb5165c567", "tag": "bc186c4d-5060-45ec-81fa-6d90f5ac14d9"}]} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:36:37.219705 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:36:37.219705 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: warnings.warn(msg) Oct 29 01:36:37.228871 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [req-c4acd3dd-2a47-46c1-8261-87e6d7ba4478 req-9a611e20-780b-4560-a9b1-cc1bd2a7d050 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:37.230317 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [req-c4acd3dd-2a47-46c1-8261-87e6d7ba4478 req-9a611e20-780b-4560-a9b1-cc1bd2a7d050 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:37.243657 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.compute.server_external_events [req-c4acd3dd-2a47-46c1-8261-87e6d7ba4478 req-9a611e20-780b-4560-a9b1-cc1bd2a7d050 service nova] Creating event network-changed:bc186c4d-5060-45ec-81fa-6d90f5ac14d9 for instance bb92bdbd-28c2-4c34-9bc2-78bb5165c567 on hv-cinder-81398 Oct 29 01:36:37.250208 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [req-c4acd3dd-2a47-46c1-8261-87e6d7ba4478 req-9a611e20-780b-4560-a9b1-cc1bd2a7d050 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036790 Oct 29 01:36:37.250208 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 538/1088] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Oct 29 01:36:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:36:37.300788 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-85c4cdf6-3411-43a1-8862-0b1ac95ebcaf tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c50a525003e427ba5ff9dea8f4ed47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0db42704249b29fba70abbda7991c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:37.308448 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-85c4cdf6-3411-43a1-8862-0b1ac95ebcaf tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] 10.222.0.87 "GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f" status: 200 len: 1577 microversion: 2.1 time: 0.184802 Oct 29 01:36:37.309032 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 551/1089] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:36:37 2021] GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f => generated 1577 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:36:37.546312 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-e5c4f701-eb78-4413-9573-2af83c6df617 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:37.547004 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-e5c4f701-eb78-4413-9573-2af83c6df617 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] [instance: f69664c9-6a0c-4807-a429-f39a1823f6ac] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:37.553116 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-e5c4f701-eb78-4413-9573-2af83c6df617 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:37.553711 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-e5c4f701-eb78-4413-9573-2af83c6df617 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:37.554494 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-e5c4f701-eb78-4413-9573-2af83c6df617 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:37.554920 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-e5c4f701-eb78-4413-9573-2af83c6df617 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:37.686342 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-e5c4f701-eb78-4413-9573-2af83c6df617 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef8571ef39b4efe8f510a28052e2b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84bceeeb4f67456a90779360ffc620aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:37.696472 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-e5c4f701-eb78-4413-9573-2af83c6df617 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] 10.222.0.87 "GET /compute/v2.1/servers/f69664c9-6a0c-4807-a429-f39a1823f6ac" status: 200 len: 1577 microversion: 2.1 time: 0.154173 Oct 29 01:36:37.697376 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 539/1090] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:36:37 2021] GET /compute/v2.1/servers/f69664c9-6a0c-4807-a429-f39a1823f6ac => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:36:37.897583 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-25937cb1-615f-47cf-a1d4-d7d58fee553c tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:37.898142 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-25937cb1-615f-47cf-a1d4-d7d58fee553c tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] [instance: bb92bdbd-28c2-4c34-9bc2-78bb5165c567] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:37.904287 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-25937cb1-615f-47cf-a1d4-d7d58fee553c tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:37.904728 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-25937cb1-615f-47cf-a1d4-d7d58fee553c tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:37.905533 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-25937cb1-615f-47cf-a1d4-d7d58fee553c tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:37.906614 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-25937cb1-615f-47cf-a1d4-d7d58fee553c tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:38.082107 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-25937cb1-615f-47cf-a1d4-d7d58fee553c tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7b600cfde24de9809afe2b55db97cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8778e689b6e42e2b16d49b3fe762ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:38.090811 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-25937cb1-615f-47cf-a1d4-d7d58fee553c tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] 10.222.0.87 "GET /compute/v2.1/servers/bb92bdbd-28c2-4c34-9bc2-78bb5165c567" status: 200 len: 1318 microversion: 2.1 time: 0.197663 Oct 29 01:36:38.094034 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 552/1091] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:36:37 2021] GET /compute/v2.1/servers/bb92bdbd-28c2-4c34-9bc2-78bb5165c567 => generated 1318 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:36:38.325671 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-2abb8b81-6e05-4c47-accd-a6d4d997d623 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:38.326997 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-2abb8b81-6e05-4c47-accd-a6d4d997d623 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] [instance: 58f3409d-cd2a-4bef-9ae4-2fba782b321f] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:38.335448 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-2abb8b81-6e05-4c47-accd-a6d4d997d623 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:38.335937 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-2abb8b81-6e05-4c47-accd-a6d4d997d623 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:38.336741 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-2abb8b81-6e05-4c47-accd-a6d4d997d623 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:38.337179 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-2abb8b81-6e05-4c47-accd-a6d4d997d623 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:38.570014 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-2abb8b81-6e05-4c47-accd-a6d4d997d623 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c50a525003e427ba5ff9dea8f4ed47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0db42704249b29fba70abbda7991c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:38.577410 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-2abb8b81-6e05-4c47-accd-a6d4d997d623 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] 10.222.0.87 "GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f" status: 200 len: 1564 microversion: 2.1 time: 0.255391 Oct 29 01:36:38.579247 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 540/1092] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:36:38 2021] GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f => generated 1564 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:36:38.715909 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-5c76231b-c53a-486e-a46f-ec6df8ee4c73 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:38.716816 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-5c76231b-c53a-486e-a46f-ec6df8ee4c73 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] [instance: f69664c9-6a0c-4807-a429-f39a1823f6ac] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:38.722425 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-5c76231b-c53a-486e-a46f-ec6df8ee4c73 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:38.722953 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-5c76231b-c53a-486e-a46f-ec6df8ee4c73 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:38.723719 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-5c76231b-c53a-486e-a46f-ec6df8ee4c73 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:38.724167 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-5c76231b-c53a-486e-a46f-ec6df8ee4c73 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:38.845382 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-5c76231b-c53a-486e-a46f-ec6df8ee4c73 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef8571ef39b4efe8f510a28052e2b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84bceeeb4f67456a90779360ffc620aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:38.854787 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-5c76231b-c53a-486e-a46f-ec6df8ee4c73 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] 10.222.0.87 "GET /compute/v2.1/servers/f69664c9-6a0c-4807-a429-f39a1823f6ac" status: 200 len: 1509 microversion: 2.1 time: 0.142483 Oct 29 01:36:38.855398 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 553/1093] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:36:38 2021] GET /compute/v2.1/servers/f69664c9-6a0c-4807-a429-f39a1823f6ac => generated 1509 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:36:39.048038 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [req-457c7bcf-d6c6-4ba1-9cb5-3fa41d789741 req-09283d87-927c-4690-8653-9204d39993ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f69664c9-6a0c-4807-a429-f39a1823f6ac", "name": "network-vif-deleted", "tag": "569ffd45-8958-4842-9d3e-75bdbaf74160"}]} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:36:39.049760 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:36:39.049760 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: warnings.warn(msg) Oct 29 01:36:39.057987 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [req-457c7bcf-d6c6-4ba1-9cb5-3fa41d789741 req-09283d87-927c-4690-8653-9204d39993ce service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:39.064879 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [req-457c7bcf-d6c6-4ba1-9cb5-3fa41d789741 req-09283d87-927c-4690-8653-9204d39993ce service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:39.071721 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.compute.server_external_events [req-457c7bcf-d6c6-4ba1-9cb5-3fa41d789741 req-09283d87-927c-4690-8653-9204d39993ce service nova] Creating event network-vif-deleted:569ffd45-8958-4842-9d3e-75bdbaf74160 for instance f69664c9-6a0c-4807-a429-f39a1823f6ac on hv-cinder-81398 Oct 29 01:36:39.077391 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [req-457c7bcf-d6c6-4ba1-9cb5-3fa41d789741 req-09283d87-927c-4690-8653-9204d39993ce service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034081 Oct 29 01:36:39.078392 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 541/1094] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Oct 29 01:36:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:36:39.108869 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-04f475e6-e441-4499-93b0-d4f0f1f38db3 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:39.109638 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-04f475e6-e441-4499-93b0-d4f0f1f38db3 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] [instance: bb92bdbd-28c2-4c34-9bc2-78bb5165c567] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:39.117014 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-04f475e6-e441-4499-93b0-d4f0f1f38db3 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:39.117459 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-04f475e6-e441-4499-93b0-d4f0f1f38db3 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:39.118455 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-04f475e6-e441-4499-93b0-d4f0f1f38db3 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:39.118886 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-04f475e6-e441-4499-93b0-d4f0f1f38db3 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:39.315707 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-04f475e6-e441-4499-93b0-d4f0f1f38db3 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7b600cfde24de9809afe2b55db97cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8778e689b6e42e2b16d49b3fe762ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:39.331369 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-04f475e6-e441-4499-93b0-d4f0f1f38db3 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] 10.222.0.87 "GET /compute/v2.1/servers/bb92bdbd-28c2-4c34-9bc2-78bb5165c567" status: 200 len: 1318 microversion: 2.1 time: 0.226375 Oct 29 01:36:39.332627 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 554/1095] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:36:39 2021] GET /compute/v2.1/servers/bb92bdbd-28c2-4c34-9bc2-78bb5165c567 => generated 1318 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:36:39.880457 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-80d06cdf-4146-4190-9ea4-00c67419e879 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:39.882552 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-80d06cdf-4146-4190-9ea4-00c67419e879 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] [instance: f69664c9-6a0c-4807-a429-f39a1823f6ac] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:39.891336 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-80d06cdf-4146-4190-9ea4-00c67419e879 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:39.891819 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-80d06cdf-4146-4190-9ea4-00c67419e879 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:39.892702 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-80d06cdf-4146-4190-9ea4-00c67419e879 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:39.893142 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-80d06cdf-4146-4190-9ea4-00c67419e879 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:39.928851 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-80d06cdf-4146-4190-9ea4-00c67419e879 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:39.929344 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-80d06cdf-4146-4190-9ea4-00c67419e879 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:39.929823 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.objects.instance [None req-80d06cdf-4146-4190-9ea4-00c67419e879 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lazy-loading 'fault' on Instance uuid f69664c9-6a0c-4807-a429-f39a1823f6ac {{(pid=116379) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 01:36:39.981382 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-80d06cdf-4146-4190-9ea4-00c67419e879 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef8571ef39b4efe8f510a28052e2b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84bceeeb4f67456a90779360ffc620aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:39.989002 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-80d06cdf-4146-4190-9ea4-00c67419e879 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] 10.222.0.87 "GET /compute/v2.1/servers/f69664c9-6a0c-4807-a429-f39a1823f6ac" status: 200 len: 1230 microversion: 2.1 time: 0.115288 Oct 29 01:36:39.989729 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 542/1096] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:36:39 2021] GET /compute/v2.1/servers/f69664c9-6a0c-4807-a429-f39a1823f6ac => generated 1230 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:36:40.348600 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-e6bcfd76-eaac-4fa8-b394-fd70f3a5df5d tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:40.349171 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-e6bcfd76-eaac-4fa8-b394-fd70f3a5df5d tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] [instance: bb92bdbd-28c2-4c34-9bc2-78bb5165c567] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:40.356150 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-e6bcfd76-eaac-4fa8-b394-fd70f3a5df5d tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:40.361514 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-e6bcfd76-eaac-4fa8-b394-fd70f3a5df5d tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:40.361514 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-e6bcfd76-eaac-4fa8-b394-fd70f3a5df5d tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:40.361514 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-e6bcfd76-eaac-4fa8-b394-fd70f3a5df5d tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:40.494525 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-e6bcfd76-eaac-4fa8-b394-fd70f3a5df5d tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7b600cfde24de9809afe2b55db97cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8778e689b6e42e2b16d49b3fe762ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:40.501848 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-e6bcfd76-eaac-4fa8-b394-fd70f3a5df5d tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] 10.222.0.87 "GET /compute/v2.1/servers/bb92bdbd-28c2-4c34-9bc2-78bb5165c567" status: 200 len: 1318 microversion: 2.1 time: 0.157040 Oct 29 01:36:40.502422 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 555/1097] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:36:40 2021] GET /compute/v2.1/servers/bb92bdbd-28c2-4c34-9bc2-78bb5165c567 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:36:41.010815 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-b99db8b6-573c-456c-8046-e0bc8fca3932 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:41.011536 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-b99db8b6-573c-456c-8046-e0bc8fca3932 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] [instance: f69664c9-6a0c-4807-a429-f39a1823f6ac] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:41.018214 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-b99db8b6-573c-456c-8046-e0bc8fca3932 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:41.018696 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-b99db8b6-573c-456c-8046-e0bc8fca3932 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:41.019545 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-b99db8b6-573c-456c-8046-e0bc8fca3932 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:41.020051 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-b99db8b6-573c-456c-8046-e0bc8fca3932 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:41.034781 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.wsgi [None req-b99db8b6-573c-456c-8046-e0bc8fca3932 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] HTTP exception thrown: Instance f69664c9-6a0c-4807-a429-f39a1823f6ac could not be found. Oct 29 01:36:41.035420 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-b99db8b6-573c-456c-8046-e0bc8fca3932 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Returning 404 to user: Instance f69664c9-6a0c-4807-a429-f39a1823f6ac could not be found. {{(pid=116379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:36:41.036359 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-b99db8b6-573c-456c-8046-e0bc8fca3932 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] 10.222.0.87 "GET /compute/v2.1/servers/f69664c9-6a0c-4807-a429-f39a1823f6ac" status: 404 len: 111 microversion: 2.1 time: 0.029888 Oct 29 01:36:41.036950 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 543/1098] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:36:41 2021] GET /compute/v2.1/servers/f69664c9-6a0c-4807-a429-f39a1823f6ac => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:36:41.132215 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-2c6b3290-12f2-40eb-8896-cc7d4178b199 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1007435738", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1481000100", "security_groups": [{"name": "tempest-secgroup-smoke-1031308803"}], "block_device_mapping_v2": [{"uuid": "84cb3b7b-67e3-4a86-9a3e-81e0be88681f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b37af5eb-5268-42f9-a4b9-3756fed9194f"}]}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:36:41.237449 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.network.neutron [None req-2c6b3290-12f2-40eb-8896-cc7d4178b199 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] validate_networks() for [('b37af5eb-5268-42f9-a4b9-3756fed9194f', None, None, None, None, None)] {{(pid=116378) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 29 01:36:41.397189 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [req-d0fddaff-9bdb-4922-adc9-64192b702c3d req-869ca1f0-ca16-40d4-9b2c-b66815d36b13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb92bdbd-28c2-4c34-9bc2-78bb5165c567", "name": "network-vif-plugged", "status": "completed", "tag": "bc186c4d-5060-45ec-81fa-6d90f5ac14d9"}]} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:36:41.398978 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:36:41.398978 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: warnings.warn(msg) Oct 29 01:36:41.406077 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [req-d0fddaff-9bdb-4922-adc9-64192b702c3d req-869ca1f0-ca16-40d4-9b2c-b66815d36b13 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:41.406646 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [req-d0fddaff-9bdb-4922-adc9-64192b702c3d req-869ca1f0-ca16-40d4-9b2c-b66815d36b13 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:41.418922 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.compute.server_external_events [req-d0fddaff-9bdb-4922-adc9-64192b702c3d req-869ca1f0-ca16-40d4-9b2c-b66815d36b13 service nova] Creating event network-vif-plugged:bc186c4d-5060-45ec-81fa-6d90f5ac14d9 for instance bb92bdbd-28c2-4c34-9bc2-78bb5165c567 on hv-cinder-81398 Oct 29 01:36:41.423937 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [req-d0fddaff-9bdb-4922-adc9-64192b702c3d req-869ca1f0-ca16-40d4-9b2c-b66815d36b13 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030521 Oct 29 01:36:41.424542 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 544/1099] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Oct 29 01:36:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:36:41.519784 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-35337bd1-b552-47eb-b443-f0136623a610 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:41.521240 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-35337bd1-b552-47eb-b443-f0136623a610 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] [instance: bb92bdbd-28c2-4c34-9bc2-78bb5165c567] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:41.528151 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-35337bd1-b552-47eb-b443-f0136623a610 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:41.528566 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-35337bd1-b552-47eb-b443-f0136623a610 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:41.529624 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-35337bd1-b552-47eb-b443-f0136623a610 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:41.530066 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-35337bd1-b552-47eb-b443-f0136623a610 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:41.687923 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.virt.hardware [None req-2c6b3290-12f2-40eb-8896-cc7d4178b199 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Flavor limits 0:0:0 {{(pid=116378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:36:41.688440 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.virt.hardware [None req-2c6b3290-12f2-40eb-8896-cc7d4178b199 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Image limits 0:0:0 {{(pid=116378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:36:41.688806 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.virt.hardware [None req-2c6b3290-12f2-40eb-8896-cc7d4178b199 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Flavor pref 0:0:0 {{(pid=116378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:36:41.689213 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.virt.hardware [None req-2c6b3290-12f2-40eb-8896-cc7d4178b199 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Image pref 0:0:0 {{(pid=116378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:36:41.689629 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.virt.hardware [None req-2c6b3290-12f2-40eb-8896-cc7d4178b199 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116378) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:36:41.698934 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-2c6b3290-12f2-40eb-8896-cc7d4178b199 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:41.699170 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-2c6b3290-12f2-40eb-8896-cc7d4178b199 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:41.700034 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-2c6b3290-12f2-40eb-8896-cc7d4178b199 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:41.700465 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-2c6b3290-12f2-40eb-8896-cc7d4178b199 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:41.718358 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.quota [None req-2c6b3290-12f2-40eb-8896-cc7d4178b199 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Getting quotas for project 84bceeeb4f67456a90779360ffc620aa. Resources: {'instances', 'cores', 'ram'} {{(pid=116378) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 01:36:41.722165 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.quota [None req-2c6b3290-12f2-40eb-8896-cc7d4178b199 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Getting quotas for user bef8571ef39b4efe8f510a28052e2b6f and project 84bceeeb4f67456a90779360ffc620aa. Resources: {'instances', 'cores', 'ram'} {{(pid=116378) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 01:36:41.744571 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-35337bd1-b552-47eb-b443-f0136623a610 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7b600cfde24de9809afe2b55db97cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8778e689b6e42e2b16d49b3fe762ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:41.753204 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-35337bd1-b552-47eb-b443-f0136623a610 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] 10.222.0.87 "GET /compute/v2.1/servers/bb92bdbd-28c2-4c34-9bc2-78bb5165c567" status: 200 len: 1318 microversion: 2.1 time: 0.238306 Oct 29 01:36:41.753985 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 545/1100] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:36:41 2021] GET /compute/v2.1/servers/bb92bdbd-28c2-4c34-9bc2-78bb5165c567 => generated 1318 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:36:41.780311 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-2c6b3290-12f2-40eb-8896-cc7d4178b199 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Going to run 1 instances... {{(pid=116378) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 29 01:36:41.782371 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-2c6b3290-12f2-40eb-8896-cc7d4178b199 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] [instance: 529a34b2-5f55-4469-bace-404db6318de3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='84cb3b7b-67e3-4a86-9a3e-81e0be88681f',volume_size=None,volume_type=None)] {{(pid=116378) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 29 01:36:42.172058 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-2c6b3290-12f2-40eb-8896-cc7d4178b199 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.043666 Oct 29 01:36:42.172705 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 556/1101] 10.222.0.87 () {60 vars in 1146 bytes} [Fri Oct 29 01:36:41 2021] POST /compute/v2.1/servers => generated 406 bytes in 1045 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 29 01:36:42.182611 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-6d675433-8cca-4e61-b31d-7750e977ed07 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:42.183202 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-6d675433-8cca-4e61-b31d-7750e977ed07 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] [instance: 529a34b2-5f55-4469-bace-404db6318de3] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:42.237809 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-6d675433-8cca-4e61-b31d-7750e977ed07 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef8571ef39b4efe8f510a28052e2b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84bceeeb4f67456a90779360ffc620aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:42.245075 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-6d675433-8cca-4e61-b31d-7750e977ed07 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] 10.222.0.87 "GET /compute/v2.1/servers/529a34b2-5f55-4469-bace-404db6318de3" status: 200 len: 1095 microversion: 2.1 time: 0.066055 Oct 29 01:36:42.245652 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 546/1102] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:36:42 2021] GET /compute/v2.1/servers/529a34b2-5f55-4469-bace-404db6318de3 => generated 1095 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:36:42.770399 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-9aa6ef7b-c9b3-4d94-89f8-c7d679df4157 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:42.771075 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-9aa6ef7b-c9b3-4d94-89f8-c7d679df4157 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] [instance: bb92bdbd-28c2-4c34-9bc2-78bb5165c567] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:42.777805 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-9aa6ef7b-c9b3-4d94-89f8-c7d679df4157 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:42.778248 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-9aa6ef7b-c9b3-4d94-89f8-c7d679df4157 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:42.782659 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-9aa6ef7b-c9b3-4d94-89f8-c7d679df4157 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:42.782659 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-9aa6ef7b-c9b3-4d94-89f8-c7d679df4157 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:42.904731 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-9aa6ef7b-c9b3-4d94-89f8-c7d679df4157 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7b600cfde24de9809afe2b55db97cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8778e689b6e42e2b16d49b3fe762ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:42.912023 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-9aa6ef7b-c9b3-4d94-89f8-c7d679df4157 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] 10.222.0.87 "GET /compute/v2.1/servers/bb92bdbd-28c2-4c34-9bc2-78bb5165c567" status: 200 len: 1318 microversion: 2.1 time: 0.145799 Oct 29 01:36:42.912729 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 557/1103] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:36:42 2021] GET /compute/v2.1/servers/bb92bdbd-28c2-4c34-9bc2-78bb5165c567 => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:36:43.263485 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-8b658100-73a7-46fe-9a34-cc571474377e tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:43.264285 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-8b658100-73a7-46fe-9a34-cc571474377e tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] [instance: 529a34b2-5f55-4469-bace-404db6318de3] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:43.271271 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-8b658100-73a7-46fe-9a34-cc571474377e tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:43.272293 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-8b658100-73a7-46fe-9a34-cc571474377e tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:43.273090 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-8b658100-73a7-46fe-9a34-cc571474377e tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:43.273524 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-8b658100-73a7-46fe-9a34-cc571474377e tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:43.335974 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-8b658100-73a7-46fe-9a34-cc571474377e tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef8571ef39b4efe8f510a28052e2b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84bceeeb4f67456a90779360ffc620aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:43.343298 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-8b658100-73a7-46fe-9a34-cc571474377e tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] 10.222.0.87 "GET /compute/v2.1/servers/529a34b2-5f55-4469-bace-404db6318de3" status: 200 len: 1145 microversion: 2.1 time: 0.083925 Oct 29 01:36:43.343930 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 547/1104] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:36:43 2021] GET /compute/v2.1/servers/529a34b2-5f55-4469-bace-404db6318de3 => generated 1145 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:36:43.929944 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-ff625551-351a-44b8-b305-632a2ebfd8f6 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:43.930535 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-ff625551-351a-44b8-b305-632a2ebfd8f6 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] [instance: bb92bdbd-28c2-4c34-9bc2-78bb5165c567] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:43.936951 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ff625551-351a-44b8-b305-632a2ebfd8f6 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:43.937388 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ff625551-351a-44b8-b305-632a2ebfd8f6 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:43.938150 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ff625551-351a-44b8-b305-632a2ebfd8f6 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:43.938574 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ff625551-351a-44b8-b305-632a2ebfd8f6 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:44.076643 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-ff625551-351a-44b8-b305-632a2ebfd8f6 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7b600cfde24de9809afe2b55db97cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8778e689b6e42e2b16d49b3fe762ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:44.084736 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-ff625551-351a-44b8-b305-632a2ebfd8f6 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] 10.222.0.87 "GET /compute/v2.1/servers/bb92bdbd-28c2-4c34-9bc2-78bb5165c567" status: 200 len: 1509 microversion: 2.1 time: 0.159235 Oct 29 01:36:44.085345 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 558/1105] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:36:43 2021] GET /compute/v2.1/servers/bb92bdbd-28c2-4c34-9bc2-78bb5165c567 => generated 1509 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:36:44.101077 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-fcea6a63-f27c-4651-8696-773ff5b62fa1 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5903e5eb-ff4d-42f9-a16d-eff9b958e779"}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:36:44.105555 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-fcea6a63-f27c-4651-8696-773ff5b62fa1 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] [instance: bb92bdbd-28c2-4c34-9bc2-78bb5165c567] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:44.108263 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-fcea6a63-f27c-4651-8696-773ff5b62fa1 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:44.108707 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-fcea6a63-f27c-4651-8696-773ff5b62fa1 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:44.109475 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-fcea6a63-f27c-4651-8696-773ff5b62fa1 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:44.109904 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-fcea6a63-f27c-4651-8696-773ff5b62fa1 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:44.195847 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.wsgi [None req-fcea6a63-f27c-4651-8696-773ff5b62fa1 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] HTTP exception thrown: Invalid volume: volume 5903e5eb-ff4d-42f9-a16d-eff9b958e779 is already attached to instances: e680bc8b-1a56-4a4f-b1aa-fd79a9e98da8 Oct 29 01:36:44.204800 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-fcea6a63-f27c-4651-8696-773ff5b62fa1 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Returning 400 to user: Invalid volume: volume 5903e5eb-ff4d-42f9-a16d-eff9b958e779 is already attached to instances: e680bc8b-1a56-4a4f-b1aa-fd79a9e98da8 {{(pid=116379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:36:44.204800 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-fcea6a63-f27c-4651-8696-773ff5b62fa1 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] 10.222.0.87 "POST /compute/v2.1/servers/bb92bdbd-28c2-4c34-9bc2-78bb5165c567/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100603 Oct 29 01:36:44.204800 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 548/1106] 10.222.0.87 () {60 vars in 1322 bytes} [Fri Oct 29 01:36:44 2021] POST /compute/v2.1/servers/bb92bdbd-28c2-4c34-9bc2-78bb5165c567/os-volume_attachments => generated 174 bytes in 106 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 01:36:44.263616 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-28a04f15-771b-402c-afa1-4c7496426246 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:44.264129 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-28a04f15-771b-402c-afa1-4c7496426246 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] [instance: e680bc8b-1a56-4a4f-b1aa-fd79a9e98da8] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:44.270122 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-28a04f15-771b-402c-afa1-4c7496426246 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:44.270567 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-28a04f15-771b-402c-afa1-4c7496426246 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:44.271526 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-28a04f15-771b-402c-afa1-4c7496426246 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:44.271925 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-28a04f15-771b-402c-afa1-4c7496426246 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:44.360964 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-7f487943-a3c0-400b-988f-7cd1bcf7443e tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:44.361933 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-7f487943-a3c0-400b-988f-7cd1bcf7443e tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] [instance: 529a34b2-5f55-4469-bace-404db6318de3] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:44.366381 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.objects.instance [None req-28a04f15-771b-402c-afa1-4c7496426246 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lazy-loading 'services' on Instance uuid e680bc8b-1a56-4a4f-b1aa-fd79a9e98da8 {{(pid=116378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 01:36:44.370154 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-7f487943-a3c0-400b-988f-7cd1bcf7443e tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:44.370607 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-7f487943-a3c0-400b-988f-7cd1bcf7443e tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:44.371398 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-7f487943-a3c0-400b-988f-7cd1bcf7443e tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:44.371868 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-7f487943-a3c0-400b-988f-7cd1bcf7443e tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:44.449128 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-7f487943-a3c0-400b-988f-7cd1bcf7443e tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef8571ef39b4efe8f510a28052e2b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84bceeeb4f67456a90779360ffc620aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:44.457181 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-7f487943-a3c0-400b-988f-7cd1bcf7443e tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] 10.222.0.87 "GET /compute/v2.1/servers/529a34b2-5f55-4469-bace-404db6318de3" status: 200 len: 1201 microversion: 2.1 time: 0.100308 Oct 29 01:36:44.457754 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 549/1107] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:36:44 2021] GET /compute/v2.1/servers/529a34b2-5f55-4469-bace-404db6318de3 => generated 1201 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:36:44.620893 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-28a04f15-771b-402c-afa1-4c7496426246 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] 10.222.0.87 "DELETE /compute/v2.1/servers/e680bc8b-1a56-4a4f-b1aa-fd79a9e98da8/os-volume_attachments/5903e5eb-ff4d-42f9-a16d-eff9b958e779" status: 202 len: 0 microversion: 2.1 time: 0.361453 Oct 29 01:36:44.622045 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 559/1108] 10.222.0.87 () {58 vars in 1415 bytes} [Fri Oct 29 01:36:44 2021] DELETE /compute/v2.1/servers/e680bc8b-1a56-4a4f-b1aa-fd79a9e98da8/os-volume_attachments/5903e5eb-ff4d-42f9-a16d-eff9b958e779 => generated 0 bytes in 363 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:36:44.630087 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-51f1793e-3199-4c15-a616-1de5e67baadc tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:44.631959 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-51f1793e-3199-4c15-a616-1de5e67baadc tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] [instance: e680bc8b-1a56-4a4f-b1aa-fd79a9e98da8] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:44.639191 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-51f1793e-3199-4c15-a616-1de5e67baadc tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:44.640056 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-51f1793e-3199-4c15-a616-1de5e67baadc tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:44.641084 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-51f1793e-3199-4c15-a616-1de5e67baadc tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:44.641914 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-51f1793e-3199-4c15-a616-1de5e67baadc tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:44.678807 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-51f1793e-3199-4c15-a616-1de5e67baadc tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] 10.222.0.87 "GET /compute/v2.1/servers/e680bc8b-1a56-4a4f-b1aa-fd79a9e98da8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051866 Oct 29 01:36:44.679562 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 550/1109] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Oct 29 01:36:44 2021] GET /compute/v2.1/servers/e680bc8b-1a56-4a4f-b1aa-fd79a9e98da8/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:36:45.475247 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-f2c383e1-1e4d-4554-a06b-4b72fac30ff6 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:45.476363 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-f2c383e1-1e4d-4554-a06b-4b72fac30ff6 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] [instance: 529a34b2-5f55-4469-bace-404db6318de3] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:45.483308 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-f2c383e1-1e4d-4554-a06b-4b72fac30ff6 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:45.483692 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-f2c383e1-1e4d-4554-a06b-4b72fac30ff6 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:45.484532 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-f2c383e1-1e4d-4554-a06b-4b72fac30ff6 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:45.484971 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-f2c383e1-1e4d-4554-a06b-4b72fac30ff6 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:45.690902 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-2106c072-2696-4572-888e-6b8c342c6a8e tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:45.692021 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-2106c072-2696-4572-888e-6b8c342c6a8e tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] [instance: e680bc8b-1a56-4a4f-b1aa-fd79a9e98da8] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:45.700915 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-2106c072-2696-4572-888e-6b8c342c6a8e tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:45.702112 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-2106c072-2696-4572-888e-6b8c342c6a8e tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:45.702913 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-2106c072-2696-4572-888e-6b8c342c6a8e tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:45.703349 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-2106c072-2696-4572-888e-6b8c342c6a8e tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:45.714627 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-f2c383e1-1e4d-4554-a06b-4b72fac30ff6 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef8571ef39b4efe8f510a28052e2b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84bceeeb4f67456a90779360ffc620aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:45.722478 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-f2c383e1-1e4d-4554-a06b-4b72fac30ff6 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] 10.222.0.87 "GET /compute/v2.1/servers/529a34b2-5f55-4469-bace-404db6318de3" status: 200 len: 1279 microversion: 2.1 time: 0.251419 Oct 29 01:36:45.725318 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 560/1110] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:36:45 2021] GET /compute/v2.1/servers/529a34b2-5f55-4469-bace-404db6318de3 => generated 1279 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:36:45.744326 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-2106c072-2696-4572-888e-6b8c342c6a8e tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] 10.222.0.87 "GET /compute/v2.1/servers/e680bc8b-1a56-4a4f-b1aa-fd79a9e98da8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057315 Oct 29 01:36:45.744910 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 551/1111] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Oct 29 01:36:45 2021] GET /compute/v2.1/servers/e680bc8b-1a56-4a4f-b1aa-fd79a9e98da8/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:36:46.586751 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [req-7537a8b2-4c5f-46cf-ad14-5501f51469b6 req-da4db81d-1a40-4e61-a312-2f0e1179b5fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "529a34b2-5f55-4469-bace-404db6318de3", "tag": "704607c3-0bdb-4458-b12a-5f98dc711d46"}]} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:36:46.588342 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:36:46.588342 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: warnings.warn(msg) Oct 29 01:36:46.596032 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [req-7537a8b2-4c5f-46cf-ad14-5501f51469b6 req-da4db81d-1a40-4e61-a312-2f0e1179b5fe service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:46.596810 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [req-7537a8b2-4c5f-46cf-ad14-5501f51469b6 req-da4db81d-1a40-4e61-a312-2f0e1179b5fe service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:46.611198 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.compute.server_external_events [req-7537a8b2-4c5f-46cf-ad14-5501f51469b6 req-da4db81d-1a40-4e61-a312-2f0e1179b5fe service nova] Creating event network-changed:704607c3-0bdb-4458-b12a-5f98dc711d46 for instance 529a34b2-5f55-4469-bace-404db6318de3 on hv-cinder-81398 Oct 29 01:36:46.614747 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [req-7537a8b2-4c5f-46cf-ad14-5501f51469b6 req-da4db81d-1a40-4e61-a312-2f0e1179b5fe service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031875 Oct 29 01:36:46.616962 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 561/1112] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Oct 29 01:36:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:36:46.741683 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-749b864c-fd66-413e-a128-051618ebf981 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:46.742451 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-749b864c-fd66-413e-a128-051618ebf981 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] [instance: 529a34b2-5f55-4469-bace-404db6318de3] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:46.748861 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-749b864c-fd66-413e-a128-051618ebf981 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:46.749197 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-749b864c-fd66-413e-a128-051618ebf981 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:46.749978 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-749b864c-fd66-413e-a128-051618ebf981 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:46.750416 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-749b864c-fd66-413e-a128-051618ebf981 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:46.760112 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-6462f053-def8-4045-ab20-a2b03681eff2 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:46.761559 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-6462f053-def8-4045-ab20-a2b03681eff2 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] [instance: e680bc8b-1a56-4a4f-b1aa-fd79a9e98da8] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:46.767589 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-6462f053-def8-4045-ab20-a2b03681eff2 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:46.768072 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-6462f053-def8-4045-ab20-a2b03681eff2 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:46.768935 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-6462f053-def8-4045-ab20-a2b03681eff2 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:46.769368 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-6462f053-def8-4045-ab20-a2b03681eff2 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:46.810793 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-6462f053-def8-4045-ab20-a2b03681eff2 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] 10.222.0.87 "GET /compute/v2.1/servers/e680bc8b-1a56-4a4f-b1aa-fd79a9e98da8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054802 Oct 29 01:36:46.811387 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 562/1113] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Oct 29 01:36:46 2021] GET /compute/v2.1/servers/e680bc8b-1a56-4a4f-b1aa-fd79a9e98da8/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:36:46.984446 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-749b864c-fd66-413e-a128-051618ebf981 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef8571ef39b4efe8f510a28052e2b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84bceeeb4f67456a90779360ffc620aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:46.992344 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-749b864c-fd66-413e-a128-051618ebf981 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] 10.222.0.87 "GET /compute/v2.1/servers/529a34b2-5f55-4469-bace-404db6318de3" status: 200 len: 1267 microversion: 2.1 time: 0.254927 Oct 29 01:36:46.992922 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 552/1114] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:36:46 2021] GET /compute/v2.1/servers/529a34b2-5f55-4469-bace-404db6318de3 => generated 1267 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:36:47.823469 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-5ea35a25-65c0-4d98-bbcb-e749d502ca1e tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:47.824458 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-5ea35a25-65c0-4d98-bbcb-e749d502ca1e tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] [instance: e680bc8b-1a56-4a4f-b1aa-fd79a9e98da8] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:47.830727 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-5ea35a25-65c0-4d98-bbcb-e749d502ca1e tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:47.831168 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-5ea35a25-65c0-4d98-bbcb-e749d502ca1e tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:47.831951 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-5ea35a25-65c0-4d98-bbcb-e749d502ca1e tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:47.832376 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-5ea35a25-65c0-4d98-bbcb-e749d502ca1e tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:47.861613 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-5ea35a25-65c0-4d98-bbcb-e749d502ca1e tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] 10.222.0.87 "GET /compute/v2.1/servers/e680bc8b-1a56-4a4f-b1aa-fd79a9e98da8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042111 Oct 29 01:36:47.862169 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 563/1115] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Oct 29 01:36:47 2021] GET /compute/v2.1/servers/e680bc8b-1a56-4a4f-b1aa-fd79a9e98da8/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:36:47.970194 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-b713eda4-b8b2-4fec-8139-617c53744119 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1228886879", "imageRef": "3b1d5dc6-2b04-4433-9a93-1db6a740092b", "flavorRef": "452", "networks": [{"uuid": "55f0bc8e-67fb-4207-a774-2feb6c3222d3"}]}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:36:48.010889 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-745c4e58-b7fe-4aa3-b177-ea5fb2368b62 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:48.011494 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-745c4e58-b7fe-4aa3-b177-ea5fb2368b62 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] [instance: 529a34b2-5f55-4469-bace-404db6318de3] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:48.017432 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-745c4e58-b7fe-4aa3-b177-ea5fb2368b62 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:48.017881 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-745c4e58-b7fe-4aa3-b177-ea5fb2368b62 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:48.018661 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-745c4e58-b7fe-4aa3-b177-ea5fb2368b62 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:48.019110 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-745c4e58-b7fe-4aa3-b177-ea5fb2368b62 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:48.027203 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.network.neutron [None req-b713eda4-b8b2-4fec-8139-617c53744119 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] validate_networks() for [('55f0bc8e-67fb-4207-a774-2feb6c3222d3', None, None, None, None, None)] {{(pid=116379) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 29 01:36:48.238987 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-745c4e58-b7fe-4aa3-b177-ea5fb2368b62 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef8571ef39b4efe8f510a28052e2b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84bceeeb4f67456a90779360ffc620aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:48.247382 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-745c4e58-b7fe-4aa3-b177-ea5fb2368b62 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] 10.222.0.87 "GET /compute/v2.1/servers/529a34b2-5f55-4469-bace-404db6318de3" status: 200 len: 1267 microversion: 2.1 time: 0.241376 Oct 29 01:36:48.251567 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 564/1116] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:36:48 2021] GET /compute/v2.1/servers/529a34b2-5f55-4469-bace-404db6318de3 => generated 1267 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:36:48.479080 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.virt.hardware [None req-b713eda4-b8b2-4fec-8139-617c53744119 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Flavor limits 0:0:0 {{(pid=116379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:36:48.479499 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.virt.hardware [None req-b713eda4-b8b2-4fec-8139-617c53744119 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Image limits 0:0:0 {{(pid=116379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:36:48.479995 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.virt.hardware [None req-b713eda4-b8b2-4fec-8139-617c53744119 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Flavor pref 0:0:0 {{(pid=116379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:36:48.480402 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.virt.hardware [None req-b713eda4-b8b2-4fec-8139-617c53744119 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Image pref 0:0:0 {{(pid=116379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:36:48.480839 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.virt.hardware [None req-b713eda4-b8b2-4fec-8139-617c53744119 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:36:48.489334 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-b713eda4-b8b2-4fec-8139-617c53744119 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:48.489774 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-b713eda4-b8b2-4fec-8139-617c53744119 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:48.490873 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-b713eda4-b8b2-4fec-8139-617c53744119 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:48.491307 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-b713eda4-b8b2-4fec-8139-617c53744119 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:48.507481 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.quota [None req-b713eda4-b8b2-4fec-8139-617c53744119 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Getting quotas for project b8778e689b6e42e2b16d49b3fe762ac6. Resources: {'instances', 'cores', 'ram'} {{(pid=116379) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 01:36:48.511412 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.quota [None req-b713eda4-b8b2-4fec-8139-617c53744119 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Getting quotas for user 3c7b600cfde24de9809afe2b55db97cf and project b8778e689b6e42e2b16d49b3fe762ac6. Resources: {'instances', 'cores', 'ram'} {{(pid=116379) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 01:36:48.522430 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-b713eda4-b8b2-4fec-8139-617c53744119 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Going to run 1 instances... {{(pid=116379) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 29 01:36:48.524782 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-b713eda4-b8b2-4fec-8139-617c53744119 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] [instance: b6006714-9da6-42de-ac04-ffb4ed8e5949] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3b1d5dc6-2b04-4433-9a93-1db6a740092b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116379) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 29 01:36:48.656298 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-b713eda4-b8b2-4fec-8139-617c53744119 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.686579 Oct 29 01:36:48.656298 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 553/1117] 10.222.0.87 () {60 vars in 1146 bytes} [Fri Oct 29 01:36:47 2021] POST /compute/v2.1/servers => generated 380 bytes in 688 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:36:48.664357 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-78955347-cc99-466c-88c3-ec0f5463da4c tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:48.664965 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-78955347-cc99-466c-88c3-ec0f5463da4c tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] [instance: b6006714-9da6-42de-ac04-ffb4ed8e5949] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:48.724152 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-78955347-cc99-466c-88c3-ec0f5463da4c tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7b600cfde24de9809afe2b55db97cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8778e689b6e42e2b16d49b3fe762ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:48.732015 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-78955347-cc99-466c-88c3-ec0f5463da4c tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] 10.222.0.87 "GET /compute/v2.1/servers/b6006714-9da6-42de-ac04-ffb4ed8e5949" status: 200 len: 1218 microversion: 2.1 time: 0.071578 Oct 29 01:36:48.735487 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 565/1118] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:36:48 2021] GET /compute/v2.1/servers/b6006714-9da6-42de-ac04-ffb4ed8e5949 => generated 1218 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:36:49.264786 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-eb112612-f2a5-4510-9f73-24b4e8eca2f6 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:49.265395 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-eb112612-f2a5-4510-9f73-24b4e8eca2f6 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] [instance: 529a34b2-5f55-4469-bace-404db6318de3] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:49.276804 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-eb112612-f2a5-4510-9f73-24b4e8eca2f6 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:49.277249 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-eb112612-f2a5-4510-9f73-24b4e8eca2f6 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:49.278039 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-eb112612-f2a5-4510-9f73-24b4e8eca2f6 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:49.278475 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-eb112612-f2a5-4510-9f73-24b4e8eca2f6 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:49.425182 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-eb112612-f2a5-4510-9f73-24b4e8eca2f6 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef8571ef39b4efe8f510a28052e2b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84bceeeb4f67456a90779360ffc620aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:49.434962 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-eb112612-f2a5-4510-9f73-24b4e8eca2f6 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] 10.222.0.87 "GET /compute/v2.1/servers/529a34b2-5f55-4469-bace-404db6318de3" status: 200 len: 1267 microversion: 2.1 time: 0.174349 Oct 29 01:36:49.438385 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 554/1119] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:36:49 2021] GET /compute/v2.1/servers/529a34b2-5f55-4469-bace-404db6318de3 => generated 1267 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:36:49.748290 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-c0c85978-66e6-43fd-8db5-5746b39861a2 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:49.748869 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-c0c85978-66e6-43fd-8db5-5746b39861a2 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] [instance: b6006714-9da6-42de-ac04-ffb4ed8e5949] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:49.756685 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c0c85978-66e6-43fd-8db5-5746b39861a2 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:49.757130 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c0c85978-66e6-43fd-8db5-5746b39861a2 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:49.757908 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c0c85978-66e6-43fd-8db5-5746b39861a2 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:49.758332 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c0c85978-66e6-43fd-8db5-5746b39861a2 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:49.822466 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-c0c85978-66e6-43fd-8db5-5746b39861a2 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7b600cfde24de9809afe2b55db97cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8778e689b6e42e2b16d49b3fe762ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:49.830253 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-c0c85978-66e6-43fd-8db5-5746b39861a2 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] 10.222.0.87 "GET /compute/v2.1/servers/b6006714-9da6-42de-ac04-ffb4ed8e5949" status: 200 len: 1222 microversion: 2.1 time: 0.085747 Oct 29 01:36:49.830816 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 566/1120] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:36:49 2021] GET /compute/v2.1/servers/b6006714-9da6-42de-ac04-ffb4ed8e5949 => generated 1222 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:36:50.452206 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-b0a24967-b14f-47d4-8fb5-3412c97c3747 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:50.452827 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-b0a24967-b14f-47d4-8fb5-3412c97c3747 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] [instance: 529a34b2-5f55-4469-bace-404db6318de3] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:50.460160 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-b0a24967-b14f-47d4-8fb5-3412c97c3747 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:50.460613 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-b0a24967-b14f-47d4-8fb5-3412c97c3747 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:50.461426 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-b0a24967-b14f-47d4-8fb5-3412c97c3747 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:50.461858 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-b0a24967-b14f-47d4-8fb5-3412c97c3747 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:50.596440 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-b0a24967-b14f-47d4-8fb5-3412c97c3747 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef8571ef39b4efe8f510a28052e2b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84bceeeb4f67456a90779360ffc620aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:50.604524 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-b0a24967-b14f-47d4-8fb5-3412c97c3747 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] 10.222.0.87 "GET /compute/v2.1/servers/529a34b2-5f55-4469-bace-404db6318de3" status: 200 len: 1267 microversion: 2.1 time: 0.155881 Oct 29 01:36:50.605309 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 555/1121] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:36:50 2021] GET /compute/v2.1/servers/529a34b2-5f55-4469-bace-404db6318de3 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:36:50.851466 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-bc17db3d-0de8-4e13-877b-ab96773d6d1e tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:50.853031 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-bc17db3d-0de8-4e13-877b-ab96773d6d1e tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] [instance: b6006714-9da6-42de-ac04-ffb4ed8e5949] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:50.864156 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-bc17db3d-0de8-4e13-877b-ab96773d6d1e tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:50.865138 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-bc17db3d-0de8-4e13-877b-ab96773d6d1e tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:50.866798 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-bc17db3d-0de8-4e13-877b-ab96773d6d1e tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:50.867925 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-bc17db3d-0de8-4e13-877b-ab96773d6d1e tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:50.948773 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-bc17db3d-0de8-4e13-877b-ab96773d6d1e tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7b600cfde24de9809afe2b55db97cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8778e689b6e42e2b16d49b3fe762ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:50.956472 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-bc17db3d-0de8-4e13-877b-ab96773d6d1e tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] 10.222.0.87 "GET /compute/v2.1/servers/b6006714-9da6-42de-ac04-ffb4ed8e5949" status: 200 len: 1288 microversion: 2.1 time: 0.113098 Oct 29 01:36:50.957052 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 567/1122] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:36:50 2021] GET /compute/v2.1/servers/b6006714-9da6-42de-ac04-ffb4ed8e5949 => generated 1288 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:36:51.626047 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-0e5d173a-1605-4abb-b42e-5ef0ca0548c2 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:51.626853 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-0e5d173a-1605-4abb-b42e-5ef0ca0548c2 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] [instance: 529a34b2-5f55-4469-bace-404db6318de3] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:51.637339 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-0e5d173a-1605-4abb-b42e-5ef0ca0548c2 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:51.637778 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-0e5d173a-1605-4abb-b42e-5ef0ca0548c2 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:51.638757 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-0e5d173a-1605-4abb-b42e-5ef0ca0548c2 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:51.639197 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-0e5d173a-1605-4abb-b42e-5ef0ca0548c2 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:51.974943 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-baded86e-deb3-4cfc-b5bd-62af26482565 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:51.975901 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-baded86e-deb3-4cfc-b5bd-62af26482565 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] [instance: b6006714-9da6-42de-ac04-ffb4ed8e5949] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:51.982339 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-baded86e-deb3-4cfc-b5bd-62af26482565 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:51.982787 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-baded86e-deb3-4cfc-b5bd-62af26482565 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:51.983576 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-baded86e-deb3-4cfc-b5bd-62af26482565 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:51.984040 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-baded86e-deb3-4cfc-b5bd-62af26482565 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:51.984599 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-0e5d173a-1605-4abb-b42e-5ef0ca0548c2 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef8571ef39b4efe8f510a28052e2b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84bceeeb4f67456a90779360ffc620aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:51.994782 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-0e5d173a-1605-4abb-b42e-5ef0ca0548c2 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] 10.222.0.87 "GET /compute/v2.1/servers/529a34b2-5f55-4469-bace-404db6318de3" status: 200 len: 1267 microversion: 2.1 time: 0.375110 Oct 29 01:36:52.001206 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 556/1123] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:36:51 2021] GET /compute/v2.1/servers/529a34b2-5f55-4469-bace-404db6318de3 => generated 1267 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:36:52.213113 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-baded86e-deb3-4cfc-b5bd-62af26482565 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7b600cfde24de9809afe2b55db97cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8778e689b6e42e2b16d49b3fe762ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:52.220526 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-baded86e-deb3-4cfc-b5bd-62af26482565 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] 10.222.0.87 "GET /compute/v2.1/servers/b6006714-9da6-42de-ac04-ffb4ed8e5949" status: 200 len: 1318 microversion: 2.1 time: 0.250017 Oct 29 01:36:52.221105 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 568/1124] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:36:51 2021] GET /compute/v2.1/servers/b6006714-9da6-42de-ac04-ffb4ed8e5949 => generated 1318 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:36:52.673740 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [req-0d5005ec-5ade-4370-91fd-215a23dffe8b req-153f6d44-989a-4c88-82ab-72103178d5a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6006714-9da6-42de-ac04-ffb4ed8e5949", "tag": "d21b1202-4ed9-4ea8-a35b-777bda0c7a2b"}]} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:36:52.675976 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:36:52.675976 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: warnings.warn(msg) Oct 29 01:36:52.685556 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [req-0d5005ec-5ade-4370-91fd-215a23dffe8b req-153f6d44-989a-4c88-82ab-72103178d5a2 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:52.688949 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [req-0d5005ec-5ade-4370-91fd-215a23dffe8b req-153f6d44-989a-4c88-82ab-72103178d5a2 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:52.703220 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.compute.server_external_events [req-0d5005ec-5ade-4370-91fd-215a23dffe8b req-153f6d44-989a-4c88-82ab-72103178d5a2 service nova] Creating event network-changed:d21b1202-4ed9-4ea8-a35b-777bda0c7a2b for instance b6006714-9da6-42de-ac04-ffb4ed8e5949 on hv-cinder-81398 Oct 29 01:36:52.709968 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [req-0d5005ec-5ade-4370-91fd-215a23dffe8b req-153f6d44-989a-4c88-82ab-72103178d5a2 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039974 Oct 29 01:36:52.710744 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 557/1125] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Oct 29 01:36:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:36:53.012705 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-08491db9-6e46-42a7-82d1-ae235a24e0f5 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:53.013414 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-08491db9-6e46-42a7-82d1-ae235a24e0f5 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] [instance: 529a34b2-5f55-4469-bace-404db6318de3] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:53.019125 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-08491db9-6e46-42a7-82d1-ae235a24e0f5 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:53.019574 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-08491db9-6e46-42a7-82d1-ae235a24e0f5 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:53.020386 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-08491db9-6e46-42a7-82d1-ae235a24e0f5 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:53.020834 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-08491db9-6e46-42a7-82d1-ae235a24e0f5 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:53.242365 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-08491db9-6e46-42a7-82d1-ae235a24e0f5 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef8571ef39b4efe8f510a28052e2b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84bceeeb4f67456a90779360ffc620aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:53.244783 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-e68d6158-5c24-4986-bc8a-76025f7f0c79 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:53.246202 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-e68d6158-5c24-4986-bc8a-76025f7f0c79 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] [instance: b6006714-9da6-42de-ac04-ffb4ed8e5949] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:53.254246 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-08491db9-6e46-42a7-82d1-ae235a24e0f5 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] 10.222.0.87 "GET /compute/v2.1/servers/529a34b2-5f55-4469-bace-404db6318de3" status: 200 len: 1267 microversion: 2.1 time: 0.244871 Oct 29 01:36:53.255172 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 569/1126] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:36:53 2021] GET /compute/v2.1/servers/529a34b2-5f55-4469-bace-404db6318de3 => generated 1267 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:36:53.257295 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-e68d6158-5c24-4986-bc8a-76025f7f0c79 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:53.257779 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-e68d6158-5c24-4986-bc8a-76025f7f0c79 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:53.258575 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-e68d6158-5c24-4986-bc8a-76025f7f0c79 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:53.259009 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-e68d6158-5c24-4986-bc8a-76025f7f0c79 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:53.483994 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-e68d6158-5c24-4986-bc8a-76025f7f0c79 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7b600cfde24de9809afe2b55db97cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8778e689b6e42e2b16d49b3fe762ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:53.492487 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-e68d6158-5c24-4986-bc8a-76025f7f0c79 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] 10.222.0.87 "GET /compute/v2.1/servers/b6006714-9da6-42de-ac04-ffb4ed8e5949" status: 200 len: 1318 microversion: 2.1 time: 0.256793 Oct 29 01:36:53.493056 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 558/1127] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:36:53 2021] GET /compute/v2.1/servers/b6006714-9da6-42de-ac04-ffb4ed8e5949 => generated 1318 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:36:54.282808 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-af9e03fd-7dd3-4dfd-8761-2ca15f18b479 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:54.283413 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-af9e03fd-7dd3-4dfd-8761-2ca15f18b479 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] [instance: 529a34b2-5f55-4469-bace-404db6318de3] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:54.290578 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-af9e03fd-7dd3-4dfd-8761-2ca15f18b479 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:54.291015 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-af9e03fd-7dd3-4dfd-8761-2ca15f18b479 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:54.291795 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-af9e03fd-7dd3-4dfd-8761-2ca15f18b479 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:54.292301 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-af9e03fd-7dd3-4dfd-8761-2ca15f18b479 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:54.417397 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-af9e03fd-7dd3-4dfd-8761-2ca15f18b479 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef8571ef39b4efe8f510a28052e2b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84bceeeb4f67456a90779360ffc620aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:54.424781 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-af9e03fd-7dd3-4dfd-8761-2ca15f18b479 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] 10.222.0.87 "GET /compute/v2.1/servers/529a34b2-5f55-4469-bace-404db6318de3" status: 200 len: 1267 microversion: 2.1 time: 0.146024 Oct 29 01:36:54.425358 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 570/1128] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:36:54 2021] GET /compute/v2.1/servers/529a34b2-5f55-4469-bace-404db6318de3 => generated 1267 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:36:54.508794 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-0ba0377e-0af4-491e-9532-36d138726a84 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:54.509405 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-0ba0377e-0af4-491e-9532-36d138726a84 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] [instance: b6006714-9da6-42de-ac04-ffb4ed8e5949] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:54.515716 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-0ba0377e-0af4-491e-9532-36d138726a84 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:54.516195 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-0ba0377e-0af4-491e-9532-36d138726a84 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:54.516969 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-0ba0377e-0af4-491e-9532-36d138726a84 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:54.517403 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-0ba0377e-0af4-491e-9532-36d138726a84 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:54.645823 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-0ba0377e-0af4-491e-9532-36d138726a84 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7b600cfde24de9809afe2b55db97cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8778e689b6e42e2b16d49b3fe762ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:54.653703 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-0ba0377e-0af4-491e-9532-36d138726a84 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] 10.222.0.87 "GET /compute/v2.1/servers/b6006714-9da6-42de-ac04-ffb4ed8e5949" status: 200 len: 1318 microversion: 2.1 time: 0.148919 Oct 29 01:36:54.654257 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 559/1129] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:36:54 2021] GET /compute/v2.1/servers/b6006714-9da6-42de-ac04-ffb4ed8e5949 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:36:55.442254 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-bdc79d17-880f-496b-9fdb-deb2aea7a909 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:55.443558 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-bdc79d17-880f-496b-9fdb-deb2aea7a909 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] [instance: 529a34b2-5f55-4469-bace-404db6318de3] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:55.449860 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-bdc79d17-880f-496b-9fdb-deb2aea7a909 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:55.450297 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-bdc79d17-880f-496b-9fdb-deb2aea7a909 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:55.451062 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-bdc79d17-880f-496b-9fdb-deb2aea7a909 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:55.451489 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-bdc79d17-880f-496b-9fdb-deb2aea7a909 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:55.587653 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-bdc79d17-880f-496b-9fdb-deb2aea7a909 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef8571ef39b4efe8f510a28052e2b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84bceeeb4f67456a90779360ffc620aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:55.597688 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-bdc79d17-880f-496b-9fdb-deb2aea7a909 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] 10.222.0.87 "GET /compute/v2.1/servers/529a34b2-5f55-4469-bace-404db6318de3" status: 200 len: 1267 microversion: 2.1 time: 0.158965 Oct 29 01:36:55.598264 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 571/1130] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:36:55 2021] GET /compute/v2.1/servers/529a34b2-5f55-4469-bace-404db6318de3 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:36:55.670371 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-89123ca7-7d55-420d-9cac-5a186e459b9c tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:55.671025 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-89123ca7-7d55-420d-9cac-5a186e459b9c tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] [instance: b6006714-9da6-42de-ac04-ffb4ed8e5949] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:55.677908 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-89123ca7-7d55-420d-9cac-5a186e459b9c tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:55.678375 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-89123ca7-7d55-420d-9cac-5a186e459b9c tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:55.679135 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-89123ca7-7d55-420d-9cac-5a186e459b9c tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:55.679566 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-89123ca7-7d55-420d-9cac-5a186e459b9c tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:55.818737 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-89123ca7-7d55-420d-9cac-5a186e459b9c tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7b600cfde24de9809afe2b55db97cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8778e689b6e42e2b16d49b3fe762ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:55.825717 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-89123ca7-7d55-420d-9cac-5a186e459b9c tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] 10.222.0.87 "GET /compute/v2.1/servers/b6006714-9da6-42de-ac04-ffb4ed8e5949" status: 200 len: 1318 microversion: 2.1 time: 0.159009 Oct 29 01:36:55.826285 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 560/1131] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:36:55 2021] GET /compute/v2.1/servers/b6006714-9da6-42de-ac04-ffb4ed8e5949 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:36:56.616116 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-75a1c2d7-f1dc-462f-8086-fa40e5d1f609 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:56.616742 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-75a1c2d7-f1dc-462f-8086-fa40e5d1f609 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] [instance: 529a34b2-5f55-4469-bace-404db6318de3] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:56.623117 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-75a1c2d7-f1dc-462f-8086-fa40e5d1f609 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:56.623562 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-75a1c2d7-f1dc-462f-8086-fa40e5d1f609 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:56.624381 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-75a1c2d7-f1dc-462f-8086-fa40e5d1f609 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:56.624792 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-75a1c2d7-f1dc-462f-8086-fa40e5d1f609 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:56.758433 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-75a1c2d7-f1dc-462f-8086-fa40e5d1f609 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef8571ef39b4efe8f510a28052e2b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84bceeeb4f67456a90779360ffc620aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:56.772217 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-75a1c2d7-f1dc-462f-8086-fa40e5d1f609 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] 10.222.0.87 "GET /compute/v2.1/servers/529a34b2-5f55-4469-bace-404db6318de3" status: 200 len: 1267 microversion: 2.1 time: 0.159914 Oct 29 01:36:56.773149 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 572/1132] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:36:56 2021] GET /compute/v2.1/servers/529a34b2-5f55-4469-bace-404db6318de3 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:36:56.841899 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-1e066873-cb36-47cf-b321-6cd4ec69bc0f tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:56.842586 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-1e066873-cb36-47cf-b321-6cd4ec69bc0f tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] [instance: b6006714-9da6-42de-ac04-ffb4ed8e5949] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:56.848876 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-1e066873-cb36-47cf-b321-6cd4ec69bc0f tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:56.849398 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-1e066873-cb36-47cf-b321-6cd4ec69bc0f tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:56.850177 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-1e066873-cb36-47cf-b321-6cd4ec69bc0f tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:56.850616 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-1e066873-cb36-47cf-b321-6cd4ec69bc0f tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:56.982901 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-1e066873-cb36-47cf-b321-6cd4ec69bc0f tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7b600cfde24de9809afe2b55db97cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8778e689b6e42e2b16d49b3fe762ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:56.991310 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-1e066873-cb36-47cf-b321-6cd4ec69bc0f tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] 10.222.0.87 "GET /compute/v2.1/servers/b6006714-9da6-42de-ac04-ffb4ed8e5949" status: 200 len: 1318 microversion: 2.1 time: 0.153117 Oct 29 01:36:56.991916 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 561/1133] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:36:56 2021] GET /compute/v2.1/servers/b6006714-9da6-42de-ac04-ffb4ed8e5949 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:36:57.797000 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-7600c0c4-a242-4942-ba4b-d592ce69d739 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:57.798198 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-7600c0c4-a242-4942-ba4b-d592ce69d739 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] [instance: 529a34b2-5f55-4469-bace-404db6318de3] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:57.806357 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-7600c0c4-a242-4942-ba4b-d592ce69d739 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:57.806823 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-7600c0c4-a242-4942-ba4b-d592ce69d739 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:57.807642 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-7600c0c4-a242-4942-ba4b-d592ce69d739 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:57.808120 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-7600c0c4-a242-4942-ba4b-d592ce69d739 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:57.957240 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-7600c0c4-a242-4942-ba4b-d592ce69d739 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef8571ef39b4efe8f510a28052e2b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84bceeeb4f67456a90779360ffc620aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:57.968045 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-7600c0c4-a242-4942-ba4b-d592ce69d739 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] 10.222.0.87 "GET /compute/v2.1/servers/529a34b2-5f55-4469-bace-404db6318de3" status: 200 len: 1267 microversion: 2.1 time: 0.178220 Oct 29 01:36:57.968719 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 573/1134] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:36:57 2021] GET /compute/v2.1/servers/529a34b2-5f55-4469-bace-404db6318de3 => generated 1267 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:36:58.008950 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-9a011ec3-fe60-4f4c-827d-7e5bab53201c tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:58.009547 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-9a011ec3-fe60-4f4c-827d-7e5bab53201c tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] [instance: b6006714-9da6-42de-ac04-ffb4ed8e5949] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:58.015825 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-9a011ec3-fe60-4f4c-827d-7e5bab53201c tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:58.016256 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-9a011ec3-fe60-4f4c-827d-7e5bab53201c tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:58.017019 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-9a011ec3-fe60-4f4c-827d-7e5bab53201c tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:58.017444 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-9a011ec3-fe60-4f4c-827d-7e5bab53201c tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:58.154510 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-9a011ec3-fe60-4f4c-827d-7e5bab53201c tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7b600cfde24de9809afe2b55db97cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8778e689b6e42e2b16d49b3fe762ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:58.163425 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-9a011ec3-fe60-4f4c-827d-7e5bab53201c tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] 10.222.0.87 "GET /compute/v2.1/servers/b6006714-9da6-42de-ac04-ffb4ed8e5949" status: 200 len: 1318 microversion: 2.1 time: 0.158805 Oct 29 01:36:58.164062 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 562/1135] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:36:58 2021] GET /compute/v2.1/servers/b6006714-9da6-42de-ac04-ffb4ed8e5949 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:36:58.984733 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-a8f1c1b6-db33-4679-a242-3b6fe19e1061 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:58.985350 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-a8f1c1b6-db33-4679-a242-3b6fe19e1061 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] [instance: 529a34b2-5f55-4469-bace-404db6318de3] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:58.992264 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a8f1c1b6-db33-4679-a242-3b6fe19e1061 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:58.992648 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a8f1c1b6-db33-4679-a242-3b6fe19e1061 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:58.993392 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a8f1c1b6-db33-4679-a242-3b6fe19e1061 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:58.993810 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a8f1c1b6-db33-4679-a242-3b6fe19e1061 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:59.120608 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-a8f1c1b6-db33-4679-a242-3b6fe19e1061 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef8571ef39b4efe8f510a28052e2b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84bceeeb4f67456a90779360ffc620aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:59.128297 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-a8f1c1b6-db33-4679-a242-3b6fe19e1061 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] 10.222.0.87 "GET /compute/v2.1/servers/529a34b2-5f55-4469-bace-404db6318de3" status: 200 len: 1267 microversion: 2.1 time: 0.147161 Oct 29 01:36:59.128897 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 574/1136] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:36:58 2021] GET /compute/v2.1/servers/529a34b2-5f55-4469-bace-404db6318de3 => generated 1267 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:36:59.181507 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-e42caa85-5c4b-43de-895d-986d2547c7da tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:36:59.182120 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-e42caa85-5c4b-43de-895d-986d2547c7da tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] [instance: b6006714-9da6-42de-ac04-ffb4ed8e5949] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:36:59.188987 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-e42caa85-5c4b-43de-895d-986d2547c7da tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:59.189472 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-e42caa85-5c4b-43de-895d-986d2547c7da tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:59.190353 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-e42caa85-5c4b-43de-895d-986d2547c7da tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:36:59.190824 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-e42caa85-5c4b-43de-895d-986d2547c7da tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:36:59.321044 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-e42caa85-5c4b-43de-895d-986d2547c7da tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7b600cfde24de9809afe2b55db97cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8778e689b6e42e2b16d49b3fe762ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:36:59.328255 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-e42caa85-5c4b-43de-895d-986d2547c7da tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] 10.222.0.87 "GET /compute/v2.1/servers/b6006714-9da6-42de-ac04-ffb4ed8e5949" status: 200 len: 1318 microversion: 2.1 time: 0.151678 Oct 29 01:36:59.328811 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 563/1137] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:36:59 2021] GET /compute/v2.1/servers/b6006714-9da6-42de-ac04-ffb4ed8e5949 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:37:00.241127 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-eade3591-49a8-47b9-bf6e-3d825161d6aa tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:00.241127 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-eade3591-49a8-47b9-bf6e-3d825161d6aa tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] [instance: 529a34b2-5f55-4469-bace-404db6318de3] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:37:00.241127 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-eade3591-49a8-47b9-bf6e-3d825161d6aa tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:00.241127 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-eade3591-49a8-47b9-bf6e-3d825161d6aa tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:00.242816 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-eade3591-49a8-47b9-bf6e-3d825161d6aa tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:00.242816 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-eade3591-49a8-47b9-bf6e-3d825161d6aa tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:00.299698 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-eade3591-49a8-47b9-bf6e-3d825161d6aa tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef8571ef39b4efe8f510a28052e2b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84bceeeb4f67456a90779360ffc620aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:00.309397 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-eade3591-49a8-47b9-bf6e-3d825161d6aa tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] 10.222.0.87 "GET /compute/v2.1/servers/529a34b2-5f55-4469-bace-404db6318de3" status: 200 len: 1267 microversion: 2.1 time: 0.165282 Oct 29 01:37:00.310057 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 575/1138] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:37:00 2021] GET /compute/v2.1/servers/529a34b2-5f55-4469-bace-404db6318de3 => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:37:00.351175 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-1313084a-0e86-4170-9087-79c1ad1bf666 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:00.351811 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-1313084a-0e86-4170-9087-79c1ad1bf666 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] [instance: b6006714-9da6-42de-ac04-ffb4ed8e5949] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:37:00.358191 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-1313084a-0e86-4170-9087-79c1ad1bf666 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:00.358643 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-1313084a-0e86-4170-9087-79c1ad1bf666 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:00.359418 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-1313084a-0e86-4170-9087-79c1ad1bf666 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:00.359898 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-1313084a-0e86-4170-9087-79c1ad1bf666 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:00.511927 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-1313084a-0e86-4170-9087-79c1ad1bf666 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7b600cfde24de9809afe2b55db97cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8778e689b6e42e2b16d49b3fe762ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:00.519643 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-1313084a-0e86-4170-9087-79c1ad1bf666 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] 10.222.0.87 "GET /compute/v2.1/servers/b6006714-9da6-42de-ac04-ffb4ed8e5949" status: 200 len: 1318 microversion: 2.1 time: 0.173640 Oct 29 01:37:00.520259 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 564/1139] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:37:00 2021] GET /compute/v2.1/servers/b6006714-9da6-42de-ac04-ffb4ed8e5949 => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:37:01.327532 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-6a72223b-8c39-4fd3-bd36-c5627c5583ae tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:01.328306 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-6a72223b-8c39-4fd3-bd36-c5627c5583ae tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] [instance: 529a34b2-5f55-4469-bace-404db6318de3] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:37:01.338824 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-6a72223b-8c39-4fd3-bd36-c5627c5583ae tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:01.342494 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-6a72223b-8c39-4fd3-bd36-c5627c5583ae tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:01.342494 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-6a72223b-8c39-4fd3-bd36-c5627c5583ae tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:01.342494 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-6a72223b-8c39-4fd3-bd36-c5627c5583ae tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:01.480278 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-6a72223b-8c39-4fd3-bd36-c5627c5583ae tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef8571ef39b4efe8f510a28052e2b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84bceeeb4f67456a90779360ffc620aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:01.488321 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-6a72223b-8c39-4fd3-bd36-c5627c5583ae tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] 10.222.0.87 "GET /compute/v2.1/servers/529a34b2-5f55-4469-bace-404db6318de3" status: 200 len: 1267 microversion: 2.1 time: 0.164329 Oct 29 01:37:01.488947 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 576/1140] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:37:01 2021] GET /compute/v2.1/servers/529a34b2-5f55-4469-bace-404db6318de3 => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:37:01.536261 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-4c9476be-5186-4766-b7df-be8337c60394 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:01.537082 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-4c9476be-5186-4766-b7df-be8337c60394 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] [instance: b6006714-9da6-42de-ac04-ffb4ed8e5949] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:37:01.543235 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-4c9476be-5186-4766-b7df-be8337c60394 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:01.543699 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-4c9476be-5186-4766-b7df-be8337c60394 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:01.544780 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-4c9476be-5186-4766-b7df-be8337c60394 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:01.545479 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-4c9476be-5186-4766-b7df-be8337c60394 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:01.608199 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [req-3ae3d311-9464-4043-a758-6aec2f97ab3a req-aae5e21e-7fc0-4514-b78d-09b9bd22febb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6006714-9da6-42de-ac04-ffb4ed8e5949", "name": "network-vif-plugged", "status": "completed", "tag": "d21b1202-4ed9-4ea8-a35b-777bda0c7a2b"}]} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:37:01.609759 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:37:01.609759 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: warnings.warn(msg) Oct 29 01:37:01.617936 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [req-3ae3d311-9464-4043-a758-6aec2f97ab3a req-aae5e21e-7fc0-4514-b78d-09b9bd22febb service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:01.618377 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [req-3ae3d311-9464-4043-a758-6aec2f97ab3a req-aae5e21e-7fc0-4514-b78d-09b9bd22febb service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:01.629837 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.compute.server_external_events [req-3ae3d311-9464-4043-a758-6aec2f97ab3a req-aae5e21e-7fc0-4514-b78d-09b9bd22febb service nova] Creating event network-vif-plugged:d21b1202-4ed9-4ea8-a35b-777bda0c7a2b for instance b6006714-9da6-42de-ac04-ffb4ed8e5949 on hv-cinder-81398 Oct 29 01:37:01.635157 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [req-3ae3d311-9464-4043-a758-6aec2f97ab3a req-aae5e21e-7fc0-4514-b78d-09b9bd22febb service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030883 Oct 29 01:37:01.635950 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 577/1141] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Oct 29 01:37:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:37:01.679445 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-4c9476be-5186-4766-b7df-be8337c60394 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7b600cfde24de9809afe2b55db97cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8778e689b6e42e2b16d49b3fe762ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:01.686748 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-4c9476be-5186-4766-b7df-be8337c60394 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] 10.222.0.87 "GET /compute/v2.1/servers/b6006714-9da6-42de-ac04-ffb4ed8e5949" status: 200 len: 1318 microversion: 2.1 time: 0.154567 Oct 29 01:37:01.687303 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 565/1142] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:37:01 2021] GET /compute/v2.1/servers/b6006714-9da6-42de-ac04-ffb4ed8e5949 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:37:02.507593 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-21e62da5-6e41-49a9-81bd-9082f77753ca tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:02.508312 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-21e62da5-6e41-49a9-81bd-9082f77753ca tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] [instance: 529a34b2-5f55-4469-bace-404db6318de3] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:37:02.514388 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-21e62da5-6e41-49a9-81bd-9082f77753ca tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:02.514822 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-21e62da5-6e41-49a9-81bd-9082f77753ca tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:02.515584 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-21e62da5-6e41-49a9-81bd-9082f77753ca tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:02.516054 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-21e62da5-6e41-49a9-81bd-9082f77753ca tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:02.644766 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-21e62da5-6e41-49a9-81bd-9082f77753ca tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef8571ef39b4efe8f510a28052e2b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84bceeeb4f67456a90779360ffc620aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:02.653710 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-21e62da5-6e41-49a9-81bd-9082f77753ca tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] 10.222.0.87 "GET /compute/v2.1/servers/529a34b2-5f55-4469-bace-404db6318de3" status: 200 len: 1267 microversion: 2.1 time: 0.151113 Oct 29 01:37:02.654274 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 578/1143] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:37:02 2021] GET /compute/v2.1/servers/529a34b2-5f55-4469-bace-404db6318de3 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:37:02.703699 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-593adacb-0628-48de-9f67-a492f428e5c3 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:02.704337 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-593adacb-0628-48de-9f67-a492f428e5c3 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] [instance: b6006714-9da6-42de-ac04-ffb4ed8e5949] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:37:02.712406 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-593adacb-0628-48de-9f67-a492f428e5c3 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:02.712853 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-593adacb-0628-48de-9f67-a492f428e5c3 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:02.714218 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-593adacb-0628-48de-9f67-a492f428e5c3 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:02.714218 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-593adacb-0628-48de-9f67-a492f428e5c3 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:02.847837 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-593adacb-0628-48de-9f67-a492f428e5c3 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7b600cfde24de9809afe2b55db97cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8778e689b6e42e2b16d49b3fe762ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:02.856867 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-593adacb-0628-48de-9f67-a492f428e5c3 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] 10.222.0.87 "GET /compute/v2.1/servers/b6006714-9da6-42de-ac04-ffb4ed8e5949" status: 200 len: 1318 microversion: 2.1 time: 0.156978 Oct 29 01:37:02.857508 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 566/1144] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:37:02 2021] GET /compute/v2.1/servers/b6006714-9da6-42de-ac04-ffb4ed8e5949 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:37:03.652343 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [req-3d728d76-8a4b-4107-8568-4efec91db77f req-36a36810-b263-43f9-ad78-b668108d17b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "529a34b2-5f55-4469-bace-404db6318de3", "name": "network-vif-plugged", "status": "completed", "tag": "704607c3-0bdb-4458-b12a-5f98dc711d46"}]} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:37:03.655812 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:37:03.655812 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: warnings.warn(msg) Oct 29 01:37:03.669150 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [req-3d728d76-8a4b-4107-8568-4efec91db77f req-36a36810-b263-43f9-ad78-b668108d17b3 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:03.669912 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [req-3d728d76-8a4b-4107-8568-4efec91db77f req-36a36810-b263-43f9-ad78-b668108d17b3 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:03.670263 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-8e5b77cc-1ac1-4046-b86b-4273e186bc27 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:03.670861 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-8e5b77cc-1ac1-4046-b86b-4273e186bc27 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] [instance: 529a34b2-5f55-4469-bace-404db6318de3] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:37:03.677846 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-8e5b77cc-1ac1-4046-b86b-4273e186bc27 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:03.678311 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-8e5b77cc-1ac1-4046-b86b-4273e186bc27 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:03.679090 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-8e5b77cc-1ac1-4046-b86b-4273e186bc27 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:03.679573 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-8e5b77cc-1ac1-4046-b86b-4273e186bc27 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:03.690362 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.compute.server_external_events [req-3d728d76-8a4b-4107-8568-4efec91db77f req-36a36810-b263-43f9-ad78-b668108d17b3 service nova] Creating event network-vif-plugged:704607c3-0bdb-4458-b12a-5f98dc711d46 for instance 529a34b2-5f55-4469-bace-404db6318de3 on hv-cinder-81398 Oct 29 01:37:03.697363 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [req-3d728d76-8a4b-4107-8568-4efec91db77f req-36a36810-b263-43f9-ad78-b668108d17b3 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049972 Oct 29 01:37:03.698452 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 579/1145] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Oct 29 01:37:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:37:03.817235 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-8e5b77cc-1ac1-4046-b86b-4273e186bc27 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef8571ef39b4efe8f510a28052e2b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84bceeeb4f67456a90779360ffc620aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:03.826760 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-8e5b77cc-1ac1-4046-b86b-4273e186bc27 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] 10.222.0.87 "GET /compute/v2.1/servers/529a34b2-5f55-4469-bace-404db6318de3" status: 200 len: 1267 microversion: 2.1 time: 0.160160 Oct 29 01:37:03.827334 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 567/1146] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:37:03 2021] GET /compute/v2.1/servers/529a34b2-5f55-4469-bace-404db6318de3 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:37:03.874213 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-26866e0a-2e02-46d2-a219-4e7b4997e51d tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:03.875070 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-26866e0a-2e02-46d2-a219-4e7b4997e51d tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] [instance: b6006714-9da6-42de-ac04-ffb4ed8e5949] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:37:03.881641 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-26866e0a-2e02-46d2-a219-4e7b4997e51d tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:03.882079 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-26866e0a-2e02-46d2-a219-4e7b4997e51d tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:03.882855 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-26866e0a-2e02-46d2-a219-4e7b4997e51d tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:03.883278 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-26866e0a-2e02-46d2-a219-4e7b4997e51d tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:04.041638 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-26866e0a-2e02-46d2-a219-4e7b4997e51d tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7b600cfde24de9809afe2b55db97cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8778e689b6e42e2b16d49b3fe762ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:04.041638 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-26866e0a-2e02-46d2-a219-4e7b4997e51d tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] 10.222.0.87 "GET /compute/v2.1/servers/b6006714-9da6-42de-ac04-ffb4ed8e5949" status: 200 len: 1318 microversion: 2.1 time: 0.161021 Oct 29 01:37:04.041638 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 580/1147] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:37:03 2021] GET /compute/v2.1/servers/b6006714-9da6-42de-ac04-ffb4ed8e5949 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:37:04.140580 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-68dd1a24-4bfd-4b7c-8312-9866a3cfb5d1 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:04.141582 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-68dd1a24-4bfd-4b7c-8312-9866a3cfb5d1 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:37:04.148780 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-68dd1a24-4bfd-4b7c-8312-9866a3cfb5d1 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:04.149230 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-68dd1a24-4bfd-4b7c-8312-9866a3cfb5d1 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:04.150017 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-68dd1a24-4bfd-4b7c-8312-9866a3cfb5d1 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:04.150466 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-68dd1a24-4bfd-4b7c-8312-9866a3cfb5d1 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:04.180858 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-68dd1a24-4bfd-4b7c-8312-9866a3cfb5d1 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044046 Oct 29 01:37:04.181434 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 568/1148] 10.222.0.87 () {60 vars in 1342 bytes} [Fri Oct 29 01:37:04 2021] GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:37:04.242640 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-d417584d-30bc-43d7-97d9-84ba7d4fc837 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:04.243034 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-d417584d-30bc-43d7-97d9-84ba7d4fc837 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:37:04.249016 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-d417584d-30bc-43d7-97d9-84ba7d4fc837 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:04.249453 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-d417584d-30bc-43d7-97d9-84ba7d4fc837 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:04.250208 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-d417584d-30bc-43d7-97d9-84ba7d4fc837 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:04.250632 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-d417584d-30bc-43d7-97d9-84ba7d4fc837 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:04.276546 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-d417584d-30bc-43d7-97d9-84ba7d4fc837 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Going to try to terminate instance {{(pid=116378) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 29 01:37:04.680512 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-d417584d-30bc-43d7-97d9-84ba7d4fc837 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "DELETE /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a" status: 204 len: 0 microversion: 2.20 time: 0.443919 Oct 29 01:37:04.681386 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 581/1149] 10.222.0.87 () {60 vars in 1279 bytes} [Fri Oct 29 01:37:04 2021] DELETE /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a => generated 0 bytes in 446 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 01:37:04.689108 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-eba7ebff-ff11-4bed-8ca9-257513112b82 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:04.689711 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-eba7ebff-ff11-4bed-8ca9-257513112b82 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:37:04.696025 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-eba7ebff-ff11-4bed-8ca9-257513112b82 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:04.696464 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-eba7ebff-ff11-4bed-8ca9-257513112b82 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:04.697236 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-eba7ebff-ff11-4bed-8ca9-257513112b82 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:04.697661 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-eba7ebff-ff11-4bed-8ca9-257513112b82 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:04.830515 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-eba7ebff-ff11-4bed-8ca9-257513112b82 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:04.838435 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-eba7ebff-ff11-4bed-8ca9-257513112b82 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:04.840001 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-eba7ebff-ff11-4bed-8ca9-257513112b82 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:04.841173 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-eba7ebff-ff11-4bed-8ca9-257513112b82 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a" status: 200 len: 1724 microversion: 2.20 time: 0.155833 Oct 29 01:37:04.841729 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 569/1150] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:37:04 2021] GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:37:04.845999 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-211e6c9a-b508-45a4-a0d5-f2d7fda4e022 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:04.846702 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-211e6c9a-b508-45a4-a0d5-f2d7fda4e022 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] [instance: 529a34b2-5f55-4469-bace-404db6318de3] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:37:04.853829 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-211e6c9a-b508-45a4-a0d5-f2d7fda4e022 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:04.854267 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-211e6c9a-b508-45a4-a0d5-f2d7fda4e022 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:04.855035 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-211e6c9a-b508-45a4-a0d5-f2d7fda4e022 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:04.855458 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-211e6c9a-b508-45a4-a0d5-f2d7fda4e022 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:04.981766 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-211e6c9a-b508-45a4-a0d5-f2d7fda4e022 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef8571ef39b4efe8f510a28052e2b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84bceeeb4f67456a90779360ffc620aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:04.989134 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-211e6c9a-b508-45a4-a0d5-f2d7fda4e022 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] 10.222.0.87 "GET /compute/v2.1/servers/529a34b2-5f55-4469-bace-404db6318de3" status: 200 len: 1267 microversion: 2.1 time: 0.147039 Oct 29 01:37:04.990296 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 582/1151] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:37:04 2021] GET /compute/v2.1/servers/529a34b2-5f55-4469-bace-404db6318de3 => generated 1267 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:37:05.048828 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-1ed34526-5ac4-409e-b526-6e597b5b4864 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:05.049431 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-1ed34526-5ac4-409e-b526-6e597b5b4864 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] [instance: b6006714-9da6-42de-ac04-ffb4ed8e5949] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:37:05.055434 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-1ed34526-5ac4-409e-b526-6e597b5b4864 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:05.055920 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-1ed34526-5ac4-409e-b526-6e597b5b4864 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:05.056689 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-1ed34526-5ac4-409e-b526-6e597b5b4864 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:05.057124 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-1ed34526-5ac4-409e-b526-6e597b5b4864 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:05.177857 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-1ed34526-5ac4-409e-b526-6e597b5b4864 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7b600cfde24de9809afe2b55db97cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8778e689b6e42e2b16d49b3fe762ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:05.185323 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-1ed34526-5ac4-409e-b526-6e597b5b4864 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] 10.222.0.87 "GET /compute/v2.1/servers/b6006714-9da6-42de-ac04-ffb4ed8e5949" status: 200 len: 1508 microversion: 2.1 time: 0.140136 Oct 29 01:37:05.185892 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 570/1152] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:37:05 2021] GET /compute/v2.1/servers/b6006714-9da6-42de-ac04-ffb4ed8e5949 => generated 1508 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:37:05.862678 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-a5b4f9ce-b826-4c9f-b0ea-fb68c93465ac tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:05.862678 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-a5b4f9ce-b826-4c9f-b0ea-fb68c93465ac tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:37:05.869534 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a5b4f9ce-b826-4c9f-b0ea-fb68c93465ac tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:05.869893 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a5b4f9ce-b826-4c9f-b0ea-fb68c93465ac tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:05.870892 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a5b4f9ce-b826-4c9f-b0ea-fb68c93465ac tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:05.871524 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-a5b4f9ce-b826-4c9f-b0ea-fb68c93465ac tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:06.002742 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-a5b4f9ce-b826-4c9f-b0ea-fb68c93465ac tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:06.006920 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-4c64d81f-fef8-49c9-8c4f-a2a57f00caf0 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:06.007578 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-4c64d81f-fef8-49c9-8c4f-a2a57f00caf0 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] [instance: 529a34b2-5f55-4469-bace-404db6318de3] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:37:06.013784 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-a5b4f9ce-b826-4c9f-b0ea-fb68c93465ac tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:06.014301 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-4c64d81f-fef8-49c9-8c4f-a2a57f00caf0 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:06.014758 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-4c64d81f-fef8-49c9-8c4f-a2a57f00caf0 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:06.017514 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-a5b4f9ce-b826-4c9f-b0ea-fb68c93465ac tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:06.017686 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-4c64d81f-fef8-49c9-8c4f-a2a57f00caf0 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:06.017686 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-4c64d81f-fef8-49c9-8c4f-a2a57f00caf0 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:06.017870 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-a5b4f9ce-b826-4c9f-b0ea-fb68c93465ac tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a" status: 200 len: 1724 microversion: 2.20 time: 0.159391 Oct 29 01:37:06.017870 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 583/1153] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:37:05 2021] GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:37:06.147946 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-4c64d81f-fef8-49c9-8c4f-a2a57f00caf0 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef8571ef39b4efe8f510a28052e2b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84bceeeb4f67456a90779360ffc620aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:06.155430 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-4c64d81f-fef8-49c9-8c4f-a2a57f00caf0 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] 10.222.0.87 "GET /compute/v2.1/servers/529a34b2-5f55-4469-bace-404db6318de3" status: 200 len: 1267 microversion: 2.1 time: 0.152884 Oct 29 01:37:06.156051 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 571/1154] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:37:06 2021] GET /compute/v2.1/servers/529a34b2-5f55-4469-bace-404db6318de3 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:37:06.854158 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-b2af05b0-31af-4dfc-8b14-d2affdddca33 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ca4324ac-4f70-4736-9c2f-426d062f6d71"}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:37:06.865420 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-b2af05b0-31af-4dfc-8b14-d2affdddca33 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] [instance: b6006714-9da6-42de-ac04-ffb4ed8e5949] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:37:06.865420 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-b2af05b0-31af-4dfc-8b14-d2affdddca33 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:06.865420 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-b2af05b0-31af-4dfc-8b14-d2affdddca33 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:06.865420 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-b2af05b0-31af-4dfc-8b14-d2affdddca33 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:06.866593 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-b2af05b0-31af-4dfc-8b14-d2affdddca33 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:07.036921 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-73329654-0f73-4d1d-9916-491e9e9f3f3f tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:07.037574 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-73329654-0f73-4d1d-9916-491e9e9f3f3f tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:37:07.044137 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-73329654-0f73-4d1d-9916-491e9e9f3f3f tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:07.044580 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-73329654-0f73-4d1d-9916-491e9e9f3f3f tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:07.045354 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-73329654-0f73-4d1d-9916-491e9e9f3f3f tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:07.045782 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-73329654-0f73-4d1d-9916-491e9e9f3f3f tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:07.284709 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-73329654-0f73-4d1d-9916-491e9e9f3f3f tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:07.294890 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-73329654-0f73-4d1d-9916-491e9e9f3f3f tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:07.296656 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-73329654-0f73-4d1d-9916-491e9e9f3f3f tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:07.298086 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-73329654-0f73-4d1d-9916-491e9e9f3f3f tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a" status: 200 len: 1724 microversion: 2.20 time: 0.265710 Oct 29 01:37:07.298639 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 572/1155] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:37:07 2021] GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a => generated 1724 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:37:07.303106 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-cf26067d-fe64-4fe8-8b13-5176b58854c4 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:07.303712 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-cf26067d-fe64-4fe8-8b13-5176b58854c4 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] [instance: 529a34b2-5f55-4469-bace-404db6318de3] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:37:07.309901 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-cf26067d-fe64-4fe8-8b13-5176b58854c4 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:07.310397 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-cf26067d-fe64-4fe8-8b13-5176b58854c4 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:07.311183 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-cf26067d-fe64-4fe8-8b13-5176b58854c4 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:07.311624 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-cf26067d-fe64-4fe8-8b13-5176b58854c4 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:07.806113 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-cf26067d-fe64-4fe8-8b13-5176b58854c4 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef8571ef39b4efe8f510a28052e2b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84bceeeb4f67456a90779360ffc620aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:07.813927 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-cf26067d-fe64-4fe8-8b13-5176b58854c4 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] 10.222.0.87 "GET /compute/v2.1/servers/529a34b2-5f55-4469-bace-404db6318de3" status: 200 len: 1454 microversion: 2.1 time: 0.514307 Oct 29 01:37:07.826308 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 573/1156] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:37:07 2021] GET /compute/v2.1/servers/529a34b2-5f55-4469-bace-404db6318de3 => generated 1454 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:37:07.830569 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-e9430eeb-1228-44e1-bd2e-a4959ef32083 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:07.831159 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-e9430eeb-1228-44e1-bd2e-a4959ef32083 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] [instance: 529a34b2-5f55-4469-bace-404db6318de3] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:37:07.837882 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-e9430eeb-1228-44e1-bd2e-a4959ef32083 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:07.838322 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-e9430eeb-1228-44e1-bd2e-a4959ef32083 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:07.839090 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-e9430eeb-1228-44e1-bd2e-a4959ef32083 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:07.839516 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-e9430eeb-1228-44e1-bd2e-a4959ef32083 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:07.972274 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-e9430eeb-1228-44e1-bd2e-a4959ef32083 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef8571ef39b4efe8f510a28052e2b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84bceeeb4f67456a90779360ffc620aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:07.982345 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-e9430eeb-1228-44e1-bd2e-a4959ef32083 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] 10.222.0.87 "GET /compute/v2.1/servers/529a34b2-5f55-4469-bace-404db6318de3" status: 200 len: 1454 microversion: 2.1 time: 0.155474 Oct 29 01:37:07.983110 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 574/1157] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:37:07 2021] GET /compute/v2.1/servers/529a34b2-5f55-4469-bace-404db6318de3 => generated 1454 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:37:08.273091 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-b2af05b0-31af-4dfc-8b14-d2affdddca33 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] 10.222.0.87 "POST /compute/v2.1/servers/b6006714-9da6-42de-ac04-ffb4ed8e5949/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.423831 Oct 29 01:37:08.280350 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 584/1158] 10.222.0.87 () {60 vars in 1322 bytes} [Fri Oct 29 01:37:06 2021] POST /compute/v2.1/servers/b6006714-9da6-42de-ac04-ffb4ed8e5949/os-volume_attachments => generated 194 bytes in 1431 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:37:08.326104 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-1d3aca86-9cae-416b-b155-70d8aee14bf2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:08.326104 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-1d3aca86-9cae-416b-b155-70d8aee14bf2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:37:08.338197 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-1d3aca86-9cae-416b-b155-70d8aee14bf2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:08.339184 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-1d3aca86-9cae-416b-b155-70d8aee14bf2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:08.340748 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-1d3aca86-9cae-416b-b155-70d8aee14bf2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:08.342129 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-1d3aca86-9cae-416b-b155-70d8aee14bf2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:08.447376 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [req-81d21fc5-1088-4cd6-84e0-9cb5f18797d9 req-35d5af6b-549c-400b-b892-f7768239a0d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91b62925-d26a-4afb-bab2-c0288f74404a", "name": "network-vif-deleted", "tag": "aee32650-07ba-4e45-a318-0849274af2bf"}]} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:37:08.448903 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:37:08.448903 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: warnings.warn(msg) Oct 29 01:37:08.456391 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [req-81d21fc5-1088-4cd6-84e0-9cb5f18797d9 req-35d5af6b-549c-400b-b892-f7768239a0d3 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:08.457267 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [req-81d21fc5-1088-4cd6-84e0-9cb5f18797d9 req-35d5af6b-549c-400b-b892-f7768239a0d3 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:08.479479 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.compute.server_external_events [req-81d21fc5-1088-4cd6-84e0-9cb5f18797d9 req-35d5af6b-549c-400b-b892-f7768239a0d3 service nova] Creating event network-vif-deleted:aee32650-07ba-4e45-a318-0849274af2bf for instance 91b62925-d26a-4afb-bab2-c0288f74404a on hv-cinder-81398 Oct 29 01:37:08.485071 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [req-81d21fc5-1088-4cd6-84e0-9cb5f18797d9 req-35d5af6b-549c-400b-b892-f7768239a0d3 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041870 Oct 29 01:37:08.486293 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 585/1159] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Oct 29 01:37:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:37:08.487204 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-1d3aca86-9cae-416b-b155-70d8aee14bf2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:08.503569 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-1d3aca86-9cae-416b-b155-70d8aee14bf2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:08.506158 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-1d3aca86-9cae-416b-b155-70d8aee14bf2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:08.507958 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-1d3aca86-9cae-416b-b155-70d8aee14bf2 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a" status: 200 len: 1656 microversion: 2.20 time: 0.194508 Oct 29 01:37:08.509011 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 575/1160] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:37:08 2021] GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a => generated 1656 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 01:37:09.533486 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-b7e3a286-97bd-4b6c-8d7d-56a4c3714b4c tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:09.534803 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-b7e3a286-97bd-4b6c-8d7d-56a4c3714b4c tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:37:09.542141 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-b7e3a286-97bd-4b6c-8d7d-56a4c3714b4c tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:09.545979 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-b7e3a286-97bd-4b6c-8d7d-56a4c3714b4c tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:09.545979 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-b7e3a286-97bd-4b6c-8d7d-56a4c3714b4c tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:09.545979 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-b7e3a286-97bd-4b6c-8d7d-56a4c3714b4c tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:09.581471 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-b7e3a286-97bd-4b6c-8d7d-56a4c3714b4c tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:09.582225 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-b7e3a286-97bd-4b6c-8d7d-56a4c3714b4c tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:09.583716 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.objects.instance [None req-b7e3a286-97bd-4b6c-8d7d-56a4c3714b4c tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lazy-loading 'fault' on Instance uuid 91b62925-d26a-4afb-bab2-c0288f74404a {{(pid=116378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 01:37:09.625897 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-b7e3a286-97bd-4b6c-8d7d-56a4c3714b4c tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:09.634536 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-b7e3a286-97bd-4b6c-8d7d-56a4c3714b4c tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:09.636413 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-b7e3a286-97bd-4b6c-8d7d-56a4c3714b4c tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '78823bdcff4e45d8ab82558b434f188d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413ce1a7d8504d0b9f656d9e623f9005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:09.637581 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-b7e3a286-97bd-4b6c-8d7d-56a4c3714b4c tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a" status: 200 len: 1370 microversion: 2.20 time: 0.109006 Oct 29 01:37:09.638134 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 586/1161] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:37:09 2021] GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a => generated 1370 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 01:37:10.659461 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-ce7bdb2e-2b27-4a8d-9bd0-37f2cdc2564b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:10.660070 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-ce7bdb2e-2b27-4a8d-9bd0-37f2cdc2564b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:37:10.667346 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-ce7bdb2e-2b27-4a8d-9bd0-37f2cdc2564b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:10.667807 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-ce7bdb2e-2b27-4a8d-9bd0-37f2cdc2564b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:10.668598 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-ce7bdb2e-2b27-4a8d-9bd0-37f2cdc2564b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:10.669019 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-ce7bdb2e-2b27-4a8d-9bd0-37f2cdc2564b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:10.688876 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.wsgi [None req-ce7bdb2e-2b27-4a8d-9bd0-37f2cdc2564b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] HTTP exception thrown: Instance 91b62925-d26a-4afb-bab2-c0288f74404a could not be found. Oct 29 01:37:10.689480 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-ce7bdb2e-2b27-4a8d-9bd0-37f2cdc2564b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Returning 404 to user: Instance 91b62925-d26a-4afb-bab2-c0288f74404a could not be found. {{(pid=116379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:37:10.690638 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-ce7bdb2e-2b27-4a8d-9bd0-37f2cdc2564b tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a" status: 404 len: 111 microversion: 2.20 time: 0.034815 Oct 29 01:37:10.691134 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 576/1162] 10.222.0.87 () {60 vars in 1276 bytes} [Fri Oct 29 01:37:10 2021] GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 01:37:10.700213 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-599d4264-3d3d-4cc8-97f7-667d7e459995 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '.version_select at 0x7ff63070d280>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:10.798609 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-599d4264-3d3d-4cc8-97f7-667d7e459995 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-876787345" status: 204 len: 0 microversion: 2.20 time: 0.102252 Oct 29 01:37:10.799238 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 587/1163] 10.222.0.87 () {60 vars in 1258 bytes} [Fri Oct 29 01:37:10 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-876787345 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 01:37:10.880102 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [req-6bf83057-5dca-4a0b-8643-14a1a2af997d req-8c844c92-0084-41f3-9b5b-b9e0cb788333 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "529a34b2-5f55-4469-bace-404db6318de3", "tag": "704607c3-0bdb-4458-b12a-5f98dc711d46"}]} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:37:10.881934 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:37:10.881934 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: warnings.warn(msg) Oct 29 01:37:10.892156 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [req-6bf83057-5dca-4a0b-8643-14a1a2af997d req-8c844c92-0084-41f3-9b5b-b9e0cb788333 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:10.892717 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [req-6bf83057-5dca-4a0b-8643-14a1a2af997d req-8c844c92-0084-41f3-9b5b-b9e0cb788333 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:10.905993 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.compute.server_external_events [req-6bf83057-5dca-4a0b-8643-14a1a2af997d req-8c844c92-0084-41f3-9b5b-b9e0cb788333 service nova] Creating event network-changed:704607c3-0bdb-4458-b12a-5f98dc711d46 for instance 529a34b2-5f55-4469-bace-404db6318de3 on hv-cinder-81398 Oct 29 01:37:10.912356 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [req-6bf83057-5dca-4a0b-8643-14a1a2af997d req-8c844c92-0084-41f3-9b5b-b9e0cb788333 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035929 Oct 29 01:37:10.913434 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 577/1164] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Oct 29 01:37:10 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:37:13.074889 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-df55b6a5-f2b4-4089-ac27-bf77a1c2f6f7 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:13.075463 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-df55b6a5-f2b4-4089-ac27-bf77a1c2f6f7 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:37:13.085440 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-df55b6a5-f2b4-4089-ac27-bf77a1c2f6f7 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:13.085888 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-df55b6a5-f2b4-4089-ac27-bf77a1c2f6f7 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:13.086683 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-df55b6a5-f2b4-4089-ac27-bf77a1c2f6f7 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:13.087117 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-df55b6a5-f2b4-4089-ac27-bf77a1c2f6f7 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:13.263518 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.wsgi [None req-df55b6a5-f2b4-4089-ac27-bf77a1c2f6f7 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] HTTP exception thrown: Instance 91b62925-d26a-4afb-bab2-c0288f74404a could not be found. Oct 29 01:37:13.264141 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-df55b6a5-f2b4-4089-ac27-bf77a1c2f6f7 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Returning 404 to user: Instance 91b62925-d26a-4afb-bab2-c0288f74404a could not be found. {{(pid=116378) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:37:13.265072 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-df55b6a5-f2b4-4089-ac27-bf77a1c2f6f7 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "DELETE /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a" status: 404 len: 111 microversion: 2.1 time: 0.193881 Oct 29 01:37:13.265673 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 588/1165] 10.222.0.87 () {58 vars in 1238 bytes} [Fri Oct 29 01:37:13 2021] DELETE /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a => generated 111 bytes in 195 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:37:13.275563 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-de0f4e44-1e2e-4312-918f-37323f8da5d8 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:13.278327 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-de0f4e44-1e2e-4312-918f-37323f8da5d8 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: 91b62925-d26a-4afb-bab2-c0288f74404a] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:37:13.282464 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-de0f4e44-1e2e-4312-918f-37323f8da5d8 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:13.282920 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-de0f4e44-1e2e-4312-918f-37323f8da5d8 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:13.283688 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-de0f4e44-1e2e-4312-918f-37323f8da5d8 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:13.284154 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-de0f4e44-1e2e-4312-918f-37323f8da5d8 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:13.296954 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.wsgi [None req-de0f4e44-1e2e-4312-918f-37323f8da5d8 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] HTTP exception thrown: Instance 91b62925-d26a-4afb-bab2-c0288f74404a could not be found. Oct 29 01:37:13.297545 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-de0f4e44-1e2e-4312-918f-37323f8da5d8 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Returning 404 to user: Instance 91b62925-d26a-4afb-bab2-c0288f74404a could not be found. {{(pid=116379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:37:13.298373 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-de0f4e44-1e2e-4312-918f-37323f8da5d8 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a" status: 404 len: 111 microversion: 2.1 time: 0.027551 Oct 29 01:37:13.298905 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 578/1166] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:37:13 2021] GET /compute/v2.1/servers/91b62925-d26a-4afb-bab2-c0288f74404a => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:37:14.665201 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-57c5c3e5-7f4b-4e34-a7c3-f8c757c7a015 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:14.665732 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-57c5c3e5-7f4b-4e34-a7c3-f8c757c7a015 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:37:14.672204 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-57c5c3e5-7f4b-4e34-a7c3-f8c757c7a015 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:14.672204 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-57c5c3e5-7f4b-4e34-a7c3-f8c757c7a015 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:14.672852 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-57c5c3e5-7f4b-4e34-a7c3-f8c757c7a015 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:14.673279 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-57c5c3e5-7f4b-4e34-a7c3-f8c757c7a015 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:14.686139 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.wsgi [None req-57c5c3e5-7f4b-4e34-a7c3-f8c757c7a015 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] HTTP exception thrown: Instance f64f5ebf-8af1-4507-849e-b7d8e33979ae could not be found. Oct 29 01:37:14.686730 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-57c5c3e5-7f4b-4e34-a7c3-f8c757c7a015 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Returning 404 to user: Instance f64f5ebf-8af1-4507-849e-b7d8e33979ae could not be found. {{(pid=116378) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:37:14.688918 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-57c5c3e5-7f4b-4e34-a7c3-f8c757c7a015 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "DELETE /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 404 len: 111 microversion: 2.1 time: 0.026522 Oct 29 01:37:14.688918 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 589/1167] 10.222.0.87 () {58 vars in 1238 bytes} [Fri Oct 29 01:37:14 2021] DELETE /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:37:14.697181 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-3364a292-65a6-461d-85de-ddae756ff9b6 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:14.697791 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-3364a292-65a6-461d-85de-ddae756ff9b6 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] [instance: f64f5ebf-8af1-4507-849e-b7d8e33979ae] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:37:14.704531 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-3364a292-65a6-461d-85de-ddae756ff9b6 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:14.705322 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-3364a292-65a6-461d-85de-ddae756ff9b6 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:14.706407 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-3364a292-65a6-461d-85de-ddae756ff9b6 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:14.706842 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-3364a292-65a6-461d-85de-ddae756ff9b6 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:14.721138 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.wsgi [None req-3364a292-65a6-461d-85de-ddae756ff9b6 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] HTTP exception thrown: Instance f64f5ebf-8af1-4507-849e-b7d8e33979ae could not be found. Oct 29 01:37:14.721734 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-3364a292-65a6-461d-85de-ddae756ff9b6 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] Returning 404 to user: Instance f64f5ebf-8af1-4507-849e-b7d8e33979ae could not be found. {{(pid=116379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:37:14.722701 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-3364a292-65a6-461d-85de-ddae756ff9b6 tempest-AttachVolumeShelveTestJSON-217801727 tempest-AttachVolumeShelveTestJSON-217801727-project] 10.222.0.87 "GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae" status: 404 len: 111 microversion: 2.1 time: 0.030353 Oct 29 01:37:14.723299 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 579/1168] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:37:14 2021] GET /compute/v2.1/servers/f64f5ebf-8af1-4507-849e-b7d8e33979ae => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:37:16.907126 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-5e49b072-2e54-42d0-a787-2a42e3445dbc tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ca4324ac-4f70-4736-9c2f-426d062f6d71"}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:37:16.908897 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-5e49b072-2e54-42d0-a787-2a42e3445dbc tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] [instance: b6006714-9da6-42de-ac04-ffb4ed8e5949] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:37:16.916602 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-5e49b072-2e54-42d0-a787-2a42e3445dbc tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:16.917207 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-5e49b072-2e54-42d0-a787-2a42e3445dbc tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:16.918170 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-5e49b072-2e54-42d0-a787-2a42e3445dbc tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:16.918667 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-5e49b072-2e54-42d0-a787-2a42e3445dbc tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:17.022364 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.wsgi [None req-5e49b072-2e54-42d0-a787-2a42e3445dbc tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] HTTP exception thrown: Invalid volume: volume ca4324ac-4f70-4736-9c2f-426d062f6d71 is already attached to instances: b6006714-9da6-42de-ac04-ffb4ed8e5949 Oct 29 01:37:17.023139 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-5e49b072-2e54-42d0-a787-2a42e3445dbc tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Returning 400 to user: Invalid volume: volume ca4324ac-4f70-4736-9c2f-426d062f6d71 is already attached to instances: b6006714-9da6-42de-ac04-ffb4ed8e5949 {{(pid=116378) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:37:17.024449 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-5e49b072-2e54-42d0-a787-2a42e3445dbc tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] 10.222.0.87 "POST /compute/v2.1/servers/b6006714-9da6-42de-ac04-ffb4ed8e5949/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.121230 Oct 29 01:37:17.025448 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 590/1169] 10.222.0.87 () {60 vars in 1322 bytes} [Fri Oct 29 01:37:16 2021] POST /compute/v2.1/servers/b6006714-9da6-42de-ac04-ffb4ed8e5949/os-volume_attachments => generated 174 bytes in 123 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 29 01:37:17.094960 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-8d582bcc-b821-4a11-bbf1-06653e7be770 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:17.095598 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-8d582bcc-b821-4a11-bbf1-06653e7be770 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] [instance: b6006714-9da6-42de-ac04-ffb4ed8e5949] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:37:17.101736 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-8d582bcc-b821-4a11-bbf1-06653e7be770 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:17.102186 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-8d582bcc-b821-4a11-bbf1-06653e7be770 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:17.103162 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-8d582bcc-b821-4a11-bbf1-06653e7be770 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:17.103436 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-8d582bcc-b821-4a11-bbf1-06653e7be770 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:17.185083 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.objects.instance [None req-8d582bcc-b821-4a11-bbf1-06653e7be770 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lazy-loading 'services' on Instance uuid b6006714-9da6-42de-ac04-ffb4ed8e5949 {{(pid=116379) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 01:37:17.499982 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-8d582bcc-b821-4a11-bbf1-06653e7be770 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] 10.222.0.87 "DELETE /compute/v2.1/servers/b6006714-9da6-42de-ac04-ffb4ed8e5949/os-volume_attachments/ca4324ac-4f70-4736-9c2f-426d062f6d71" status: 202 len: 0 microversion: 2.1 time: 0.409366 Oct 29 01:37:17.500604 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 580/1170] 10.222.0.87 () {58 vars in 1415 bytes} [Fri Oct 29 01:37:17 2021] DELETE /compute/v2.1/servers/b6006714-9da6-42de-ac04-ffb4ed8e5949/os-volume_attachments/ca4324ac-4f70-4736-9c2f-426d062f6d71 => generated 0 bytes in 411 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:37:17.509143 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-145e1fba-d809-48cc-ae94-bd0b0683d8d4 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:17.510015 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-145e1fba-d809-48cc-ae94-bd0b0683d8d4 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] [instance: b6006714-9da6-42de-ac04-ffb4ed8e5949] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:37:17.516729 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-145e1fba-d809-48cc-ae94-bd0b0683d8d4 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:17.517178 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-145e1fba-d809-48cc-ae94-bd0b0683d8d4 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:17.517948 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-145e1fba-d809-48cc-ae94-bd0b0683d8d4 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:17.518381 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-145e1fba-d809-48cc-ae94-bd0b0683d8d4 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:17.550580 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-145e1fba-d809-48cc-ae94-bd0b0683d8d4 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] 10.222.0.87 "GET /compute/v2.1/servers/b6006714-9da6-42de-ac04-ffb4ed8e5949/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045330 Oct 29 01:37:17.551135 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 591/1171] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Oct 29 01:37:17 2021] GET /compute/v2.1/servers/b6006714-9da6-42de-ac04-ffb4ed8e5949/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:37:18.567789 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-6b7c7a4d-6b4f-4435-95e6-ab0965ede6af tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:18.571282 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-6b7c7a4d-6b4f-4435-95e6-ab0965ede6af tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] [instance: b6006714-9da6-42de-ac04-ffb4ed8e5949] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:37:18.581208 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-6b7c7a4d-6b4f-4435-95e6-ab0965ede6af tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:18.581208 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-6b7c7a4d-6b4f-4435-95e6-ab0965ede6af tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:18.581659 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-6b7c7a4d-6b4f-4435-95e6-ab0965ede6af tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:18.581968 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-6b7c7a4d-6b4f-4435-95e6-ab0965ede6af tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:18.616576 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-6b7c7a4d-6b4f-4435-95e6-ab0965ede6af tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] 10.222.0.87 "GET /compute/v2.1/servers/b6006714-9da6-42de-ac04-ffb4ed8e5949/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056655 Oct 29 01:37:18.617860 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 581/1172] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Oct 29 01:37:18 2021] GET /compute/v2.1/servers/b6006714-9da6-42de-ac04-ffb4ed8e5949/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:37:19.632825 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-693b155f-04ca-47e1-98b8-fbecc4ee3a70 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:19.633855 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-693b155f-04ca-47e1-98b8-fbecc4ee3a70 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] [instance: b6006714-9da6-42de-ac04-ffb4ed8e5949] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:37:19.640297 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-693b155f-04ca-47e1-98b8-fbecc4ee3a70 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:19.640889 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-693b155f-04ca-47e1-98b8-fbecc4ee3a70 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:19.641756 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-693b155f-04ca-47e1-98b8-fbecc4ee3a70 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:19.642403 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-693b155f-04ca-47e1-98b8-fbecc4ee3a70 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:19.672272 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-693b155f-04ca-47e1-98b8-fbecc4ee3a70 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] 10.222.0.87 "GET /compute/v2.1/servers/b6006714-9da6-42de-ac04-ffb4ed8e5949/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043342 Oct 29 01:37:19.672984 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 592/1173] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Oct 29 01:37:19 2021] GET /compute/v2.1/servers/b6006714-9da6-42de-ac04-ffb4ed8e5949/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:37:19.829645 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-8047898c-bdae-439e-8ecb-e0be6750c1a9 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1473883849", "imageRef": "3b1d5dc6-2b04-4433-9a93-1db6a740092b", "flavorRef": "452", "networks": [{"uuid": "55f0bc8e-67fb-4207-a774-2feb6c3222d3"}]}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:37:19.894053 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.network.neutron [None req-8047898c-bdae-439e-8ecb-e0be6750c1a9 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] validate_networks() for [('55f0bc8e-67fb-4207-a774-2feb6c3222d3', None, None, None, None, None)] {{(pid=116379) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 29 01:37:20.295165 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.virt.hardware [None req-8047898c-bdae-439e-8ecb-e0be6750c1a9 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Flavor limits 0:0:0 {{(pid=116379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:37:20.295712 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.virt.hardware [None req-8047898c-bdae-439e-8ecb-e0be6750c1a9 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Image limits 0:0:0 {{(pid=116379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:37:20.296309 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.virt.hardware [None req-8047898c-bdae-439e-8ecb-e0be6750c1a9 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Flavor pref 0:0:0 {{(pid=116379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:37:20.296813 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.virt.hardware [None req-8047898c-bdae-439e-8ecb-e0be6750c1a9 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Image pref 0:0:0 {{(pid=116379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:37:20.297316 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.virt.hardware [None req-8047898c-bdae-439e-8ecb-e0be6750c1a9 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:37:20.307438 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-8047898c-bdae-439e-8ecb-e0be6750c1a9 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:20.308257 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-8047898c-bdae-439e-8ecb-e0be6750c1a9 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:20.309531 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-8047898c-bdae-439e-8ecb-e0be6750c1a9 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:20.310052 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-8047898c-bdae-439e-8ecb-e0be6750c1a9 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:20.328704 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.quota [None req-8047898c-bdae-439e-8ecb-e0be6750c1a9 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Getting quotas for project b8778e689b6e42e2b16d49b3fe762ac6. Resources: {'instances', 'cores', 'ram'} {{(pid=116379) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 01:37:20.333988 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.quota [None req-8047898c-bdae-439e-8ecb-e0be6750c1a9 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Getting quotas for user 3c7b600cfde24de9809afe2b55db97cf and project b8778e689b6e42e2b16d49b3fe762ac6. Resources: {'instances', 'cores', 'ram'} {{(pid=116379) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 01:37:20.345347 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-8047898c-bdae-439e-8ecb-e0be6750c1a9 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Going to run 1 instances... {{(pid=116379) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 29 01:37:20.347660 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-8047898c-bdae-439e-8ecb-e0be6750c1a9 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] [instance: 75ba2733-a6ae-4646-94ba-ad3edc33dc9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3b1d5dc6-2b04-4433-9a93-1db6a740092b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116379) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 29 01:37:20.538729 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-8047898c-bdae-439e-8ecb-e0be6750c1a9 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.713051 Oct 29 01:37:20.539504 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 582/1174] 10.222.0.87 () {60 vars in 1146 bytes} [Fri Oct 29 01:37:19 2021] POST /compute/v2.1/servers => generated 380 bytes in 715 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 29 01:37:20.550022 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-49ab985e-d8f3-458c-b80b-8a96f5a42232 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:20.550768 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-49ab985e-d8f3-458c-b80b-8a96f5a42232 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] [instance: 75ba2733-a6ae-4646-94ba-ad3edc33dc9c] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:37:20.617944 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-49ab985e-d8f3-458c-b80b-8a96f5a42232 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7b600cfde24de9809afe2b55db97cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8778e689b6e42e2b16d49b3fe762ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:20.627844 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-49ab985e-d8f3-458c-b80b-8a96f5a42232 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] 10.222.0.87 "GET /compute/v2.1/servers/75ba2733-a6ae-4646-94ba-ad3edc33dc9c" status: 200 len: 1218 microversion: 2.1 time: 0.079761 Oct 29 01:37:20.628977 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 593/1175] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:37:20 2021] GET /compute/v2.1/servers/75ba2733-a6ae-4646-94ba-ad3edc33dc9c => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:37:21.646541 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-fec0371f-231f-4687-a525-1e28cd1fdbb8 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:21.648948 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-fec0371f-231f-4687-a525-1e28cd1fdbb8 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] [instance: 75ba2733-a6ae-4646-94ba-ad3edc33dc9c] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:37:21.653543 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-fec0371f-231f-4687-a525-1e28cd1fdbb8 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:21.653995 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-fec0371f-231f-4687-a525-1e28cd1fdbb8 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:21.654785 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-fec0371f-231f-4687-a525-1e28cd1fdbb8 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:21.655213 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-fec0371f-231f-4687-a525-1e28cd1fdbb8 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:21.725611 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-fec0371f-231f-4687-a525-1e28cd1fdbb8 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7b600cfde24de9809afe2b55db97cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8778e689b6e42e2b16d49b3fe762ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:21.734112 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-fec0371f-231f-4687-a525-1e28cd1fdbb8 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] 10.222.0.87 "GET /compute/v2.1/servers/75ba2733-a6ae-4646-94ba-ad3edc33dc9c" status: 200 len: 1222 microversion: 2.1 time: 0.092422 Oct 29 01:37:21.734995 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 583/1176] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:37:21 2021] GET /compute/v2.1/servers/75ba2733-a6ae-4646-94ba-ad3edc33dc9c => generated 1222 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:37:22.753277 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-3d24c628-154e-4120-818f-1ac1407dad5d tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:22.753692 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-3d24c628-154e-4120-818f-1ac1407dad5d tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] [instance: 75ba2733-a6ae-4646-94ba-ad3edc33dc9c] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:37:22.760799 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-3d24c628-154e-4120-818f-1ac1407dad5d tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:22.761303 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-3d24c628-154e-4120-818f-1ac1407dad5d tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:22.762079 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-3d24c628-154e-4120-818f-1ac1407dad5d tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:22.762504 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-3d24c628-154e-4120-818f-1ac1407dad5d tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:22.851144 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-3d24c628-154e-4120-818f-1ac1407dad5d tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7b600cfde24de9809afe2b55db97cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8778e689b6e42e2b16d49b3fe762ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:22.858635 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-3d24c628-154e-4120-818f-1ac1407dad5d tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] 10.222.0.87 "GET /compute/v2.1/servers/75ba2733-a6ae-4646-94ba-ad3edc33dc9c" status: 200 len: 1270 microversion: 2.1 time: 0.110726 Oct 29 01:37:22.866514 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 594/1177] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:37:22 2021] GET /compute/v2.1/servers/75ba2733-a6ae-4646-94ba-ad3edc33dc9c => generated 1270 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:37:23.235471 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-c7c4047e-83a3-4f2b-b6b1-011b4a5a5ecd tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2114764834"}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:37:23.235471 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-c7c4047e-83a3-4f2b-b6b1-011b4a5a5ecd tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] [instance: 1faefe62-60e7-43c3-bf58-686598242ea3] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:37:23.240292 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-c7c4047e-83a3-4f2b-b6b1-011b4a5a5ecd tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:23.240779 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-c7c4047e-83a3-4f2b-b6b1-011b4a5a5ecd tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:23.242602 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-c7c4047e-83a3-4f2b-b6b1-011b4a5a5ecd tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:23.242602 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-c7c4047e-83a3-4f2b-b6b1-011b4a5a5ecd tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:23.494295 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.network.security_group_api [None req-c7c4047e-83a3-4f2b-b6b1-011b4a5a5ecd tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Removing security group 49fa0380-4c13-4599-95bc-665bdded4f90 from port 07d7a9e4-9af6-436e-932a-680c81d02f15 Oct 29 01:37:23.886904 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-580664b2-7ad7-4f34-bd14-7829556e986c tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:23.888351 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-580664b2-7ad7-4f34-bd14-7829556e986c tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] [instance: 75ba2733-a6ae-4646-94ba-ad3edc33dc9c] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:37:23.896099 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-580664b2-7ad7-4f34-bd14-7829556e986c tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:23.897062 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-580664b2-7ad7-4f34-bd14-7829556e986c tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:23.897906 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-580664b2-7ad7-4f34-bd14-7829556e986c tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:23.898585 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-580664b2-7ad7-4f34-bd14-7829556e986c tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:24.210096 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-c7c4047e-83a3-4f2b-b6b1-011b4a5a5ecd tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] 10.222.0.87 "POST /compute/v2.1/servers/1faefe62-60e7-43c3-bf58-686598242ea3/action" status: 202 len: 0 microversion: 2.1 time: 0.984282 Oct 29 01:37:24.211926 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 584/1178] 10.222.0.87 () {60 vars in 1277 bytes} [Fri Oct 29 01:37:23 2021] POST /compute/v2.1/servers/1faefe62-60e7-43c3-bf58-686598242ea3/action => generated 0 bytes in 987 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:37:24.231695 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-580664b2-7ad7-4f34-bd14-7829556e986c tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7b600cfde24de9809afe2b55db97cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8778e689b6e42e2b16d49b3fe762ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:24.235550 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [req-de4fb57e-02a5-44bc-9c78-1b9e50b4cb69 req-13364046-904e-42cd-a519-f31f05908a51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1faefe62-60e7-43c3-bf58-686598242ea3", "tag": "07d7a9e4-9af6-436e-932a-680c81d02f15"}]} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:37:24.240366 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:37:24.240366 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: warnings.warn(msg) Oct 29 01:37:24.258896 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-580664b2-7ad7-4f34-bd14-7829556e986c tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] 10.222.0.87 "GET /compute/v2.1/servers/75ba2733-a6ae-4646-94ba-ad3edc33dc9c" status: 200 len: 1318 microversion: 2.1 time: 0.375940 Oct 29 01:37:24.261673 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 595/1179] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:37:23 2021] GET /compute/v2.1/servers/75ba2733-a6ae-4646-94ba-ad3edc33dc9c => generated 1318 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:37:24.273861 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [req-de4fb57e-02a5-44bc-9c78-1b9e50b4cb69 req-13364046-904e-42cd-a519-f31f05908a51 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:24.273861 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [req-de4fb57e-02a5-44bc-9c78-1b9e50b4cb69 req-13364046-904e-42cd-a519-f31f05908a51 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:24.288583 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.compute.server_external_events [req-de4fb57e-02a5-44bc-9c78-1b9e50b4cb69 req-13364046-904e-42cd-a519-f31f05908a51 service nova] Creating event network-changed:07d7a9e4-9af6-436e-932a-680c81d02f15 for instance 1faefe62-60e7-43c3-bf58-686598242ea3 on hv-cinder-81398 Oct 29 01:37:24.295701 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [req-de4fb57e-02a5-44bc-9c78-1b9e50b4cb69 req-13364046-904e-42cd-a519-f31f05908a51 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070909 Oct 29 01:37:24.296991 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 585/1180] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Oct 29 01:37:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:37:25.282845 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-75bd8374-3815-4141-a035-51a7802ff22e tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:25.284839 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-75bd8374-3815-4141-a035-51a7802ff22e tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] [instance: 75ba2733-a6ae-4646-94ba-ad3edc33dc9c] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:37:25.295162 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-75bd8374-3815-4141-a035-51a7802ff22e tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:25.295832 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-75bd8374-3815-4141-a035-51a7802ff22e tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:25.296761 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-75bd8374-3815-4141-a035-51a7802ff22e tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:25.297293 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-75bd8374-3815-4141-a035-51a7802ff22e tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:25.637654 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-75bd8374-3815-4141-a035-51a7802ff22e tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7b600cfde24de9809afe2b55db97cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8778e689b6e42e2b16d49b3fe762ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:25.645639 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-75bd8374-3815-4141-a035-51a7802ff22e tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] 10.222.0.87 "GET /compute/v2.1/servers/75ba2733-a6ae-4646-94ba-ad3edc33dc9c" status: 200 len: 1318 microversion: 2.1 time: 0.368352 Oct 29 01:37:25.646215 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 596/1181] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:37:25 2021] GET /compute/v2.1/servers/75ba2733-a6ae-4646-94ba-ad3edc33dc9c => generated 1318 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:37:26.353449 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [req-c97c389f-1b95-4d7f-bc51-493b4a9f485c req-0ad316cf-edb4-4434-b121-9f01e4160418 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75ba2733-a6ae-4646-94ba-ad3edc33dc9c", "tag": "054881ee-300b-4f04-9447-03308c14f3f9"}]} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:37:26.355945 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:37:26.355945 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: warnings.warn(msg) Oct 29 01:37:26.371936 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [req-c97c389f-1b95-4d7f-bc51-493b4a9f485c req-0ad316cf-edb4-4434-b121-9f01e4160418 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:26.372810 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [req-c97c389f-1b95-4d7f-bc51-493b4a9f485c req-0ad316cf-edb4-4434-b121-9f01e4160418 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:26.387906 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.compute.server_external_events [req-c97c389f-1b95-4d7f-bc51-493b4a9f485c req-0ad316cf-edb4-4434-b121-9f01e4160418 service nova] Creating event network-changed:054881ee-300b-4f04-9447-03308c14f3f9 for instance 75ba2733-a6ae-4646-94ba-ad3edc33dc9c on hv-cinder-81398 Oct 29 01:37:26.393704 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [req-c97c389f-1b95-4d7f-bc51-493b4a9f485c req-0ad316cf-edb4-4434-b121-9f01e4160418 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047700 Oct 29 01:37:26.394474 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 586/1182] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Oct 29 01:37:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:37:26.666539 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-53617e74-cea2-4be5-afe8-98d58485e82d tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:26.667671 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-53617e74-cea2-4be5-afe8-98d58485e82d tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] [instance: 75ba2733-a6ae-4646-94ba-ad3edc33dc9c] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:37:26.686215 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-53617e74-cea2-4be5-afe8-98d58485e82d tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:26.687005 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-53617e74-cea2-4be5-afe8-98d58485e82d tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:26.688462 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-53617e74-cea2-4be5-afe8-98d58485e82d tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:26.689250 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-53617e74-cea2-4be5-afe8-98d58485e82d tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:27.192061 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-53617e74-cea2-4be5-afe8-98d58485e82d tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7b600cfde24de9809afe2b55db97cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8778e689b6e42e2b16d49b3fe762ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:27.198376 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-ba544f63-bed3-43a9-aa61-d156590f7a57 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:27.200393 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-ba544f63-bed3-43a9-aa61-d156590f7a57 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] [instance: 1faefe62-60e7-43c3-bf58-686598242ea3] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:37:27.209930 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-53617e74-cea2-4be5-afe8-98d58485e82d tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] 10.222.0.87 "GET /compute/v2.1/servers/75ba2733-a6ae-4646-94ba-ad3edc33dc9c" status: 200 len: 1318 microversion: 2.1 time: 0.548701 Oct 29 01:37:27.218143 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-ba544f63-bed3-43a9-aa61-d156590f7a57 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:27.221557 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-ba544f63-bed3-43a9-aa61-d156590f7a57 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:27.225611 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-ba544f63-bed3-43a9-aa61-d156590f7a57 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:27.227140 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-ba544f63-bed3-43a9-aa61-d156590f7a57 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:27.227617 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 597/1183] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:37:26 2021] GET /compute/v2.1/servers/75ba2733-a6ae-4646-94ba-ad3edc33dc9c => generated 1318 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:37:27.319755 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.objects.instance [None req-ba544f63-bed3-43a9-aa61-d156590f7a57 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lazy-loading 'services' on Instance uuid 1faefe62-60e7-43c3-bf58-686598242ea3 {{(pid=116379) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 01:37:27.601515 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-ba544f63-bed3-43a9-aa61-d156590f7a57 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] 10.222.0.87 "DELETE /compute/v2.1/servers/1faefe62-60e7-43c3-bf58-686598242ea3/os-volume_attachments/26ab03f7-8592-443d-8e9d-2b03dd5a16e2" status: 202 len: 0 microversion: 2.1 time: 0.413785 Oct 29 01:37:27.606510 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 587/1184] 10.222.0.87 () {58 vars in 1415 bytes} [Fri Oct 29 01:37:27 2021] DELETE /compute/v2.1/servers/1faefe62-60e7-43c3-bf58-686598242ea3/os-volume_attachments/26ab03f7-8592-443d-8e9d-2b03dd5a16e2 => generated 0 bytes in 417 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 01:37:27.632105 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-f10577d0-9014-493f-83d8-bf2542eb2ddb tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:27.633848 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-f10577d0-9014-493f-83d8-bf2542eb2ddb tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] [instance: 1faefe62-60e7-43c3-bf58-686598242ea3] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:37:27.649131 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-f10577d0-9014-493f-83d8-bf2542eb2ddb tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:27.649946 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-f10577d0-9014-493f-83d8-bf2542eb2ddb tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:27.651822 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-f10577d0-9014-493f-83d8-bf2542eb2ddb tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:27.652601 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-f10577d0-9014-493f-83d8-bf2542eb2ddb tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:27.714616 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-f10577d0-9014-493f-83d8-bf2542eb2ddb tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] 10.222.0.87 "GET /compute/v2.1/servers/1faefe62-60e7-43c3-bf58-686598242ea3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103108 Oct 29 01:37:27.719884 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 598/1185] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Oct 29 01:37:27 2021] GET /compute/v2.1/servers/1faefe62-60e7-43c3-bf58-686598242ea3/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:37:28.241223 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-436cf525-988c-4d2d-a4c0-e42047a908cc tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:28.242538 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-436cf525-988c-4d2d-a4c0-e42047a908cc tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] [instance: 75ba2733-a6ae-4646-94ba-ad3edc33dc9c] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:37:28.251348 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-436cf525-988c-4d2d-a4c0-e42047a908cc tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:28.257586 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-436cf525-988c-4d2d-a4c0-e42047a908cc tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:28.257586 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-436cf525-988c-4d2d-a4c0-e42047a908cc tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:28.257586 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-436cf525-988c-4d2d-a4c0-e42047a908cc tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:28.425018 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [req-4f3ab749-243e-4864-8358-b0c6320768bf req-b3cf94c4-551a-4bfa-9516-918aca97659d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1faefe62-60e7-43c3-bf58-686598242ea3", "tag": "07d7a9e4-9af6-436e-932a-680c81d02f15"}]} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:37:28.435215 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:37:28.435215 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: warnings.warn(msg) Oct 29 01:37:28.447229 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [req-4f3ab749-243e-4864-8358-b0c6320768bf req-b3cf94c4-551a-4bfa-9516-918aca97659d service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:28.448332 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [req-4f3ab749-243e-4864-8358-b0c6320768bf req-b3cf94c4-551a-4bfa-9516-918aca97659d service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:28.470054 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.compute.server_external_events [req-4f3ab749-243e-4864-8358-b0c6320768bf req-b3cf94c4-551a-4bfa-9516-918aca97659d service nova] Creating event network-changed:07d7a9e4-9af6-436e-932a-680c81d02f15 for instance 1faefe62-60e7-43c3-bf58-686598242ea3 on hv-cinder-81398 Oct 29 01:37:28.477130 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-436cf525-988c-4d2d-a4c0-e42047a908cc tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7b600cfde24de9809afe2b55db97cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8778e689b6e42e2b16d49b3fe762ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:28.489769 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [req-4f3ab749-243e-4864-8358-b0c6320768bf req-b3cf94c4-551a-4bfa-9516-918aca97659d service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063152 Oct 29 01:37:28.489769 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 599/1186] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Oct 29 01:37:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:37:28.490162 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-436cf525-988c-4d2d-a4c0-e42047a908cc tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] 10.222.0.87 "GET /compute/v2.1/servers/75ba2733-a6ae-4646-94ba-ad3edc33dc9c" status: 200 len: 1318 microversion: 2.1 time: 0.255538 Oct 29 01:37:28.492377 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 588/1187] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:37:28 2021] GET /compute/v2.1/servers/75ba2733-a6ae-4646-94ba-ad3edc33dc9c => generated 1318 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:37:28.735475 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-7d84ee82-8435-4aba-abf8-ee9464fc3685 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:28.739760 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-7d84ee82-8435-4aba-abf8-ee9464fc3685 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] [instance: 1faefe62-60e7-43c3-bf58-686598242ea3] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:37:28.754503 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-7d84ee82-8435-4aba-abf8-ee9464fc3685 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:28.756545 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-7d84ee82-8435-4aba-abf8-ee9464fc3685 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:28.758453 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-7d84ee82-8435-4aba-abf8-ee9464fc3685 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:28.762206 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-7d84ee82-8435-4aba-abf8-ee9464fc3685 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:28.828843 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-7d84ee82-8435-4aba-abf8-ee9464fc3685 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] 10.222.0.87 "GET /compute/v2.1/servers/1faefe62-60e7-43c3-bf58-686598242ea3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.101293 Oct 29 01:37:28.834556 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 600/1188] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Oct 29 01:37:28 2021] GET /compute/v2.1/servers/1faefe62-60e7-43c3-bf58-686598242ea3/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:37:29.511034 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-d9b6c46e-2b7c-4a60-9b6d-968a504cae59 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:29.511949 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-d9b6c46e-2b7c-4a60-9b6d-968a504cae59 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] [instance: 75ba2733-a6ae-4646-94ba-ad3edc33dc9c] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:37:29.519192 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d9b6c46e-2b7c-4a60-9b6d-968a504cae59 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:29.520527 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d9b6c46e-2b7c-4a60-9b6d-968a504cae59 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:29.521518 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d9b6c46e-2b7c-4a60-9b6d-968a504cae59 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:29.522171 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d9b6c46e-2b7c-4a60-9b6d-968a504cae59 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:29.673438 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-d9b6c46e-2b7c-4a60-9b6d-968a504cae59 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7b600cfde24de9809afe2b55db97cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8778e689b6e42e2b16d49b3fe762ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:29.680888 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-d9b6c46e-2b7c-4a60-9b6d-968a504cae59 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] 10.222.0.87 "GET /compute/v2.1/servers/75ba2733-a6ae-4646-94ba-ad3edc33dc9c" status: 200 len: 1318 microversion: 2.1 time: 0.174045 Oct 29 01:37:29.681457 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 589/1189] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:37:29 2021] GET /compute/v2.1/servers/75ba2733-a6ae-4646-94ba-ad3edc33dc9c => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:37:29.842605 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-91dbf6a2-469c-4e32-b7a7-bf716d499684 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:29.844016 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-91dbf6a2-469c-4e32-b7a7-bf716d499684 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] [instance: 1faefe62-60e7-43c3-bf58-686598242ea3] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:37:29.852335 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-91dbf6a2-469c-4e32-b7a7-bf716d499684 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:29.852972 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-91dbf6a2-469c-4e32-b7a7-bf716d499684 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:29.853991 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-91dbf6a2-469c-4e32-b7a7-bf716d499684 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:29.854553 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-91dbf6a2-469c-4e32-b7a7-bf716d499684 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:29.891999 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-91dbf6a2-469c-4e32-b7a7-bf716d499684 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] 10.222.0.87 "GET /compute/v2.1/servers/1faefe62-60e7-43c3-bf58-686598242ea3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053819 Oct 29 01:37:29.892872 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 601/1190] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Oct 29 01:37:29 2021] GET /compute/v2.1/servers/1faefe62-60e7-43c3-bf58-686598242ea3/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:37:29.903053 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-c4ada6cd-6b89-46a9-8fa1-b8e8787db044 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:29.903550 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-c4ada6cd-6b89-46a9-8fa1-b8e8787db044 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] [instance: 1faefe62-60e7-43c3-bf58-686598242ea3] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:37:29.909328 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-c4ada6cd-6b89-46a9-8fa1-b8e8787db044 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:29.909775 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-c4ada6cd-6b89-46a9-8fa1-b8e8787db044 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:29.911099 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-c4ada6cd-6b89-46a9-8fa1-b8e8787db044 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:29.911524 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-c4ada6cd-6b89-46a9-8fa1-b8e8787db044 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:29.990424 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.wsgi [None req-c4ada6cd-6b89-46a9-8fa1-b8e8787db044 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] HTTP exception thrown: Instance 1faefe62-60e7-43c3-bf58-686598242ea3 is not attached to volume 26ab03f7-8592-443d-8e9d-2b03dd5a16e2 Oct 29 01:37:29.991160 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-c4ada6cd-6b89-46a9-8fa1-b8e8787db044 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Returning 404 to user: Instance 1faefe62-60e7-43c3-bf58-686598242ea3 is not attached to volume 26ab03f7-8592-443d-8e9d-2b03dd5a16e2 {{(pid=116379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:37:29.992184 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-c4ada6cd-6b89-46a9-8fa1-b8e8787db044 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] 10.222.0.87 "DELETE /compute/v2.1/servers/1faefe62-60e7-43c3-bf58-686598242ea3/os-volume_attachments/26ab03f7-8592-443d-8e9d-2b03dd5a16e2" status: 404 len: 154 microversion: 2.1 time: 0.092919 Oct 29 01:37:29.992876 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 590/1191] 10.222.0.87 () {58 vars in 1415 bytes} [Fri Oct 29 01:37:29 2021] DELETE /compute/v2.1/servers/1faefe62-60e7-43c3-bf58-686598242ea3/os-volume_attachments/26ab03f7-8592-443d-8e9d-2b03dd5a16e2 => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:37:30.699103 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-4694a47c-63b5-4505-a1a5-700833c265ab tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:30.699905 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-4694a47c-63b5-4505-a1a5-700833c265ab tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] [instance: 75ba2733-a6ae-4646-94ba-ad3edc33dc9c] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:37:30.706260 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4694a47c-63b5-4505-a1a5-700833c265ab tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:30.706705 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4694a47c-63b5-4505-a1a5-700833c265ab tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:30.707587 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4694a47c-63b5-4505-a1a5-700833c265ab tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:30.708049 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4694a47c-63b5-4505-a1a5-700833c265ab tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:30.865207 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-4694a47c-63b5-4505-a1a5-700833c265ab tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7b600cfde24de9809afe2b55db97cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8778e689b6e42e2b16d49b3fe762ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:30.880407 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-4694a47c-63b5-4505-a1a5-700833c265ab tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] 10.222.0.87 "GET /compute/v2.1/servers/75ba2733-a6ae-4646-94ba-ad3edc33dc9c" status: 200 len: 1318 microversion: 2.1 time: 0.185255 Oct 29 01:37:30.881201 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 602/1192] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:37:30 2021] GET /compute/v2.1/servers/75ba2733-a6ae-4646-94ba-ad3edc33dc9c => generated 1318 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:37:31.283788 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-413f5af1-9b68-418c-97b6-c1b035fcb666 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:31.284619 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-413f5af1-9b68-418c-97b6-c1b035fcb666 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] [instance: 1faefe62-60e7-43c3-bf58-686598242ea3] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:37:31.292436 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-413f5af1-9b68-418c-97b6-c1b035fcb666 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:31.292933 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-413f5af1-9b68-418c-97b6-c1b035fcb666 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:31.293865 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-413f5af1-9b68-418c-97b6-c1b035fcb666 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:31.294392 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-413f5af1-9b68-418c-97b6-c1b035fcb666 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:31.324286 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-413f5af1-9b68-418c-97b6-c1b035fcb666 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] [instance: 1faefe62-60e7-43c3-bf58-686598242ea3] Going to try to terminate instance {{(pid=116379) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 29 01:37:31.618377 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-413f5af1-9b68-418c-97b6-c1b035fcb666 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] 10.222.0.87 "DELETE /compute/v2.1/servers/1faefe62-60e7-43c3-bf58-686598242ea3" status: 204 len: 0 microversion: 2.1 time: 0.340308 Oct 29 01:37:31.619903 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 591/1193] 10.222.0.87 () {58 vars in 1238 bytes} [Fri Oct 29 01:37:31 2021] DELETE /compute/v2.1/servers/1faefe62-60e7-43c3-bf58-686598242ea3 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:37:31.638355 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-702cbe35-abfa-4392-a837-ffbbd16c3894 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:31.645080 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-702cbe35-abfa-4392-a837-ffbbd16c3894 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] [instance: 1faefe62-60e7-43c3-bf58-686598242ea3] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:37:31.655722 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-702cbe35-abfa-4392-a837-ffbbd16c3894 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:31.661486 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-702cbe35-abfa-4392-a837-ffbbd16c3894 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:31.661486 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-702cbe35-abfa-4392-a837-ffbbd16c3894 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:31.661486 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-702cbe35-abfa-4392-a837-ffbbd16c3894 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:31.836369 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-702cbe35-abfa-4392-a837-ffbbd16c3894 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1147a77b5da48f9a75cefa0ab0e6b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700a9aa6afdf4de6b64d375544d7eb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:31.845391 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-702cbe35-abfa-4392-a837-ffbbd16c3894 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] 10.222.0.87 "GET /compute/v2.1/servers/1faefe62-60e7-43c3-bf58-686598242ea3" status: 200 len: 1554 microversion: 2.1 time: 0.213836 Oct 29 01:37:31.845979 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 603/1194] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:37:31 2021] GET /compute/v2.1/servers/1faefe62-60e7-43c3-bf58-686598242ea3 => generated 1554 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:37:31.902061 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-622fa4a5-50a2-4a6f-8120-318cbe64f79e tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:31.902939 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-622fa4a5-50a2-4a6f-8120-318cbe64f79e tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] [instance: 75ba2733-a6ae-4646-94ba-ad3edc33dc9c] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:37:31.912772 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-622fa4a5-50a2-4a6f-8120-318cbe64f79e tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:31.913509 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-622fa4a5-50a2-4a6f-8120-318cbe64f79e tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:31.914592 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-622fa4a5-50a2-4a6f-8120-318cbe64f79e tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:31.915517 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-622fa4a5-50a2-4a6f-8120-318cbe64f79e tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:32.076529 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-622fa4a5-50a2-4a6f-8120-318cbe64f79e tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7b600cfde24de9809afe2b55db97cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8778e689b6e42e2b16d49b3fe762ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:32.091388 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-622fa4a5-50a2-4a6f-8120-318cbe64f79e tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] 10.222.0.87 "GET /compute/v2.1/servers/75ba2733-a6ae-4646-94ba-ad3edc33dc9c" status: 200 len: 1318 microversion: 2.1 time: 0.193808 Oct 29 01:37:32.092652 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 592/1195] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:37:31 2021] GET /compute/v2.1/servers/75ba2733-a6ae-4646-94ba-ad3edc33dc9c => generated 1318 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:37:32.867315 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-7defd50f-9021-4124-bfee-4cca6bceae44 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:32.869369 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-7defd50f-9021-4124-bfee-4cca6bceae44 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] [instance: 1faefe62-60e7-43c3-bf58-686598242ea3] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:37:32.886312 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-7defd50f-9021-4124-bfee-4cca6bceae44 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:32.886838 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-7defd50f-9021-4124-bfee-4cca6bceae44 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:32.887660 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-7defd50f-9021-4124-bfee-4cca6bceae44 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:32.888126 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-7defd50f-9021-4124-bfee-4cca6bceae44 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:33.037607 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-7defd50f-9021-4124-bfee-4cca6bceae44 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1147a77b5da48f9a75cefa0ab0e6b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700a9aa6afdf4de6b64d375544d7eb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:33.045202 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-7defd50f-9021-4124-bfee-4cca6bceae44 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] 10.222.0.87 "GET /compute/v2.1/servers/1faefe62-60e7-43c3-bf58-686598242ea3" status: 200 len: 1554 microversion: 2.1 time: 0.184262 Oct 29 01:37:33.045779 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 604/1196] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:37:32 2021] GET /compute/v2.1/servers/1faefe62-60e7-43c3-bf58-686598242ea3 => generated 1554 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:37:33.109698 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-e8a9b8a0-5b80-4449-9a71-d16a6b74b760 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:33.110482 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-e8a9b8a0-5b80-4449-9a71-d16a6b74b760 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] [instance: 75ba2733-a6ae-4646-94ba-ad3edc33dc9c] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:37:33.117642 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-e8a9b8a0-5b80-4449-9a71-d16a6b74b760 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:33.118012 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-e8a9b8a0-5b80-4449-9a71-d16a6b74b760 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:33.118778 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-e8a9b8a0-5b80-4449-9a71-d16a6b74b760 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:33.119206 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-e8a9b8a0-5b80-4449-9a71-d16a6b74b760 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:33.244500 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-e8a9b8a0-5b80-4449-9a71-d16a6b74b760 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7b600cfde24de9809afe2b55db97cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8778e689b6e42e2b16d49b3fe762ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:33.251988 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-e8a9b8a0-5b80-4449-9a71-d16a6b74b760 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] 10.222.0.87 "GET /compute/v2.1/servers/75ba2733-a6ae-4646-94ba-ad3edc33dc9c" status: 200 len: 1318 microversion: 2.1 time: 0.145780 Oct 29 01:37:33.252460 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 593/1197] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:37:33 2021] GET /compute/v2.1/servers/75ba2733-a6ae-4646-94ba-ad3edc33dc9c => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:37:33.595124 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [req-68af8c25-b9cd-4af3-9220-f78891e9be08 req-1d8ef675-b5dd-49c1-b8d9-2fd54ad77e23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75ba2733-a6ae-4646-94ba-ad3edc33dc9c", "name": "network-vif-plugged", "status": "completed", "tag": "054881ee-300b-4f04-9447-03308c14f3f9"}]} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:37:33.596745 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:37:33.596745 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: warnings.warn(msg) Oct 29 01:37:33.605079 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [req-68af8c25-b9cd-4af3-9220-f78891e9be08 req-1d8ef675-b5dd-49c1-b8d9-2fd54ad77e23 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:33.605529 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [req-68af8c25-b9cd-4af3-9220-f78891e9be08 req-1d8ef675-b5dd-49c1-b8d9-2fd54ad77e23 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:33.617602 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.compute.server_external_events [req-68af8c25-b9cd-4af3-9220-f78891e9be08 req-1d8ef675-b5dd-49c1-b8d9-2fd54ad77e23 service nova] Creating event network-vif-plugged:054881ee-300b-4f04-9447-03308c14f3f9 for instance 75ba2733-a6ae-4646-94ba-ad3edc33dc9c on hv-cinder-81398 Oct 29 01:37:33.622614 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [req-68af8c25-b9cd-4af3-9220-f78891e9be08 req-1d8ef675-b5dd-49c1-b8d9-2fd54ad77e23 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031189 Oct 29 01:37:33.630167 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 605/1198] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Oct 29 01:37:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:37:34.065497 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-860bcca9-50ff-4c36-85e2-82c86b249cd3 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:34.066946 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-860bcca9-50ff-4c36-85e2-82c86b249cd3 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] [instance: 1faefe62-60e7-43c3-bf58-686598242ea3] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:37:34.073050 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-860bcca9-50ff-4c36-85e2-82c86b249cd3 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:34.073657 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-860bcca9-50ff-4c36-85e2-82c86b249cd3 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:34.074567 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-860bcca9-50ff-4c36-85e2-82c86b249cd3 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:34.075107 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-860bcca9-50ff-4c36-85e2-82c86b249cd3 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:34.269516 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-860bcca9-50ff-4c36-85e2-82c86b249cd3 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1147a77b5da48f9a75cefa0ab0e6b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700a9aa6afdf4de6b64d375544d7eb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:34.271486 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-b6b13c6e-c42b-4a9f-9212-f23e17c018b9 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:34.271486 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-b6b13c6e-c42b-4a9f-9212-f23e17c018b9 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] [instance: 75ba2733-a6ae-4646-94ba-ad3edc33dc9c] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:37:34.277468 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-b6b13c6e-c42b-4a9f-9212-f23e17c018b9 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:34.278001 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-b6b13c6e-c42b-4a9f-9212-f23e17c018b9 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:34.278113 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-860bcca9-50ff-4c36-85e2-82c86b249cd3 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] 10.222.0.87 "GET /compute/v2.1/servers/1faefe62-60e7-43c3-bf58-686598242ea3" status: 200 len: 1554 microversion: 2.1 time: 0.216544 Oct 29 01:37:34.287870 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 594/1199] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:37:34 2021] GET /compute/v2.1/servers/1faefe62-60e7-43c3-bf58-686598242ea3 => generated 1554 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:37:34.288101 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-b6b13c6e-c42b-4a9f-9212-f23e17c018b9 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:34.288101 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-b6b13c6e-c42b-4a9f-9212-f23e17c018b9 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:34.463475 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [req-9d761899-a9f7-462b-aad1-055c780014ee req-63208d27-9ced-47c4-bf8f-0c77897fb8ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1faefe62-60e7-43c3-bf58-686598242ea3", "name": "network-vif-deleted", "tag": "07d7a9e4-9af6-436e-932a-680c81d02f15"}]} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:37:34.465319 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:37:34.465319 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: warnings.warn(msg) Oct 29 01:37:34.473021 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [req-9d761899-a9f7-462b-aad1-055c780014ee req-63208d27-9ced-47c4-bf8f-0c77897fb8ba service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:34.473559 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [req-9d761899-a9f7-462b-aad1-055c780014ee req-63208d27-9ced-47c4-bf8f-0c77897fb8ba service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:34.485939 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.compute.server_external_events [req-9d761899-a9f7-462b-aad1-055c780014ee req-63208d27-9ced-47c4-bf8f-0c77897fb8ba service nova] Creating event network-vif-deleted:07d7a9e4-9af6-436e-932a-680c81d02f15 for instance 1faefe62-60e7-43c3-bf58-686598242ea3 on hv-cinder-81398 Oct 29 01:37:34.494967 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [req-9d761899-a9f7-462b-aad1-055c780014ee req-63208d27-9ced-47c4-bf8f-0c77897fb8ba service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032234 Oct 29 01:37:34.494967 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 595/1200] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Oct 29 01:37:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:37:34.510647 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-b6b13c6e-c42b-4a9f-9212-f23e17c018b9 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7b600cfde24de9809afe2b55db97cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8778e689b6e42e2b16d49b3fe762ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:34.518132 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-b6b13c6e-c42b-4a9f-9212-f23e17c018b9 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] 10.222.0.87 "GET /compute/v2.1/servers/75ba2733-a6ae-4646-94ba-ad3edc33dc9c" status: 200 len: 1318 microversion: 2.1 time: 0.252793 Oct 29 01:37:34.518643 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 606/1201] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:37:34 2021] GET /compute/v2.1/servers/75ba2733-a6ae-4646-94ba-ad3edc33dc9c => generated 1318 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:37:35.296123 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-d9c409c1-fcb0-4abf-82f6-4448c05d1e0f tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:35.296808 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-d9c409c1-fcb0-4abf-82f6-4448c05d1e0f tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] [instance: 1faefe62-60e7-43c3-bf58-686598242ea3] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:37:35.303526 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d9c409c1-fcb0-4abf-82f6-4448c05d1e0f tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:35.303997 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d9c409c1-fcb0-4abf-82f6-4448c05d1e0f tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:35.304766 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d9c409c1-fcb0-4abf-82f6-4448c05d1e0f tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:35.305190 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d9c409c1-fcb0-4abf-82f6-4448c05d1e0f tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:35.337846 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d9c409c1-fcb0-4abf-82f6-4448c05d1e0f tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:35.338289 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d9c409c1-fcb0-4abf-82f6-4448c05d1e0f tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:35.338738 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.objects.instance [None req-d9c409c1-fcb0-4abf-82f6-4448c05d1e0f tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lazy-loading 'fault' on Instance uuid 1faefe62-60e7-43c3-bf58-686598242ea3 {{(pid=116379) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 01:37:35.381382 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-d9c409c1-fcb0-4abf-82f6-4448c05d1e0f tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1147a77b5da48f9a75cefa0ab0e6b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '700a9aa6afdf4de6b64d375544d7eb88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:35.388795 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-d9c409c1-fcb0-4abf-82f6-4448c05d1e0f tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] 10.222.0.87 "GET /compute/v2.1/servers/1faefe62-60e7-43c3-bf58-686598242ea3" status: 200 len: 1348 microversion: 2.1 time: 0.097276 Oct 29 01:37:35.389361 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 596/1202] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:37:35 2021] GET /compute/v2.1/servers/1faefe62-60e7-43c3-bf58-686598242ea3 => generated 1348 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:37:35.535010 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-2df20775-d2bb-44cf-9e19-904ae87831fc tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:35.535918 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-2df20775-d2bb-44cf-9e19-904ae87831fc tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] [instance: 75ba2733-a6ae-4646-94ba-ad3edc33dc9c] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:37:35.542663 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-2df20775-d2bb-44cf-9e19-904ae87831fc tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:35.543101 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-2df20775-d2bb-44cf-9e19-904ae87831fc tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:35.543927 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-2df20775-d2bb-44cf-9e19-904ae87831fc tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:35.544338 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-2df20775-d2bb-44cf-9e19-904ae87831fc tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:35.673619 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-2df20775-d2bb-44cf-9e19-904ae87831fc tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7b600cfde24de9809afe2b55db97cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8778e689b6e42e2b16d49b3fe762ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:35.682315 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-2df20775-d2bb-44cf-9e19-904ae87831fc tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] 10.222.0.87 "GET /compute/v2.1/servers/75ba2733-a6ae-4646-94ba-ad3edc33dc9c" status: 200 len: 1318 microversion: 2.1 time: 0.151321 Oct 29 01:37:35.686061 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 607/1203] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:37:35 2021] GET /compute/v2.1/servers/75ba2733-a6ae-4646-94ba-ad3edc33dc9c => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:37:36.406717 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-545cc80a-36f3-42c6-9554-06476ba33bce tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:36.407313 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-545cc80a-36f3-42c6-9554-06476ba33bce tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] [instance: 1faefe62-60e7-43c3-bf58-686598242ea3] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:37:36.413820 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-545cc80a-36f3-42c6-9554-06476ba33bce tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:36.414265 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-545cc80a-36f3-42c6-9554-06476ba33bce tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:36.415032 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-545cc80a-36f3-42c6-9554-06476ba33bce tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:36.415461 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-545cc80a-36f3-42c6-9554-06476ba33bce tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:36.429003 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.wsgi [None req-545cc80a-36f3-42c6-9554-06476ba33bce tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] HTTP exception thrown: Instance 1faefe62-60e7-43c3-bf58-686598242ea3 could not be found. Oct 29 01:37:36.429584 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-545cc80a-36f3-42c6-9554-06476ba33bce tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Returning 404 to user: Instance 1faefe62-60e7-43c3-bf58-686598242ea3 could not be found. {{(pid=116379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:37:36.430448 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-545cc80a-36f3-42c6-9554-06476ba33bce tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] 10.222.0.87 "GET /compute/v2.1/servers/1faefe62-60e7-43c3-bf58-686598242ea3" status: 404 len: 111 microversion: 2.1 time: 0.027550 Oct 29 01:37:36.430996 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 597/1204] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:37:36 2021] GET /compute/v2.1/servers/1faefe62-60e7-43c3-bf58-686598242ea3 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 01:37:36.439328 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-eb772fed-6ce2-40c8-9fe0-d128fe04d241 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] Calling method '.version_select at 0x7ff62c1304c0>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:36.520203 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-eb772fed-6ce2-40c8-9fe0-d128fe04d241 tempest-TestMinimumBasicScenario-2052085217 tempest-TestMinimumBasicScenario-2052085217-project] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1789899737" status: 202 len: 0 microversion: 2.1 time: 0.084494 Oct 29 01:37:36.520814 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 608/1205] 10.222.0.87 () {58 vars in 1271 bytes} [Fri Oct 29 01:37:36 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1789899737 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:37:36.699540 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-7a134cb6-0b49-47c9-9848-bef67d2941d8 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:36.700172 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-7a134cb6-0b49-47c9-9848-bef67d2941d8 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] [instance: 75ba2733-a6ae-4646-94ba-ad3edc33dc9c] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:37:36.706434 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-7a134cb6-0b49-47c9-9848-bef67d2941d8 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:36.707007 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-7a134cb6-0b49-47c9-9848-bef67d2941d8 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:36.707909 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-7a134cb6-0b49-47c9-9848-bef67d2941d8 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:36.708334 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-7a134cb6-0b49-47c9-9848-bef67d2941d8 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:36.850708 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-7a134cb6-0b49-47c9-9848-bef67d2941d8 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7b600cfde24de9809afe2b55db97cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8778e689b6e42e2b16d49b3fe762ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:36.858332 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-7a134cb6-0b49-47c9-9848-bef67d2941d8 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] 10.222.0.87 "GET /compute/v2.1/servers/75ba2733-a6ae-4646-94ba-ad3edc33dc9c" status: 200 len: 1508 microversion: 2.1 time: 0.162519 Oct 29 01:37:36.862923 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 598/1206] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:37:36 2021] GET /compute/v2.1/servers/75ba2733-a6ae-4646-94ba-ad3edc33dc9c => generated 1508 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:37:38.927972 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-80777960-fc92-48e8-9843-c14e5870ed79 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fa8d914a-5208-4fca-b960-e82bc77a5645"}} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:37:38.929062 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-80777960-fc92-48e8-9843-c14e5870ed79 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] [instance: 75ba2733-a6ae-4646-94ba-ad3edc33dc9c] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:37:38.935898 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-80777960-fc92-48e8-9843-c14e5870ed79 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:38.936349 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-80777960-fc92-48e8-9843-c14e5870ed79 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:38.937150 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-80777960-fc92-48e8-9843-c14e5870ed79 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:38.937588 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-80777960-fc92-48e8-9843-c14e5870ed79 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:40.094563 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-80777960-fc92-48e8-9843-c14e5870ed79 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] 10.222.0.87 "POST /compute/v2.1/servers/75ba2733-a6ae-4646-94ba-ad3edc33dc9c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.171119 Oct 29 01:37:40.095506 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 609/1207] 10.222.0.87 () {60 vars in 1322 bytes} [Fri Oct 29 01:37:38 2021] POST /compute/v2.1/servers/75ba2733-a6ae-4646-94ba-ad3edc33dc9c/os-volume_attachments => generated 194 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:37:47.774700 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-e9fe2b21-23c3-44ef-9ad8-a30398424b98 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:47.776208 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-e9fe2b21-23c3-44ef-9ad8-a30398424b98 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] [instance: 75ba2733-a6ae-4646-94ba-ad3edc33dc9c] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:37:47.782549 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-e9fe2b21-23c3-44ef-9ad8-a30398424b98 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:47.783001 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-e9fe2b21-23c3-44ef-9ad8-a30398424b98 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:47.785265 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-e9fe2b21-23c3-44ef-9ad8-a30398424b98 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:47.785265 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-e9fe2b21-23c3-44ef-9ad8-a30398424b98 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:47.874344 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.objects.instance [None req-e9fe2b21-23c3-44ef-9ad8-a30398424b98 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lazy-loading 'services' on Instance uuid 75ba2733-a6ae-4646-94ba-ad3edc33dc9c {{(pid=116379) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 01:37:48.148543 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-e9fe2b21-23c3-44ef-9ad8-a30398424b98 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] 10.222.0.87 "DELETE /compute/v2.1/servers/75ba2733-a6ae-4646-94ba-ad3edc33dc9c/os-volume_attachments/fa8d914a-5208-4fca-b960-e82bc77a5645" status: 202 len: 0 microversion: 2.1 time: 0.377368 Oct 29 01:37:48.149147 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 599/1208] 10.222.0.87 () {58 vars in 1415 bytes} [Fri Oct 29 01:37:47 2021] DELETE /compute/v2.1/servers/75ba2733-a6ae-4646-94ba-ad3edc33dc9c/os-volume_attachments/fa8d914a-5208-4fca-b960-e82bc77a5645 => generated 0 bytes in 379 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:37:48.158681 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-67d70e6c-34a6-4e8d-a31b-f11380529d75 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:48.160502 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-67d70e6c-34a6-4e8d-a31b-f11380529d75 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] [instance: 75ba2733-a6ae-4646-94ba-ad3edc33dc9c] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:37:48.169229 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-67d70e6c-34a6-4e8d-a31b-f11380529d75 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:48.169684 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-67d70e6c-34a6-4e8d-a31b-f11380529d75 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:48.170473 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-67d70e6c-34a6-4e8d-a31b-f11380529d75 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:48.170903 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-67d70e6c-34a6-4e8d-a31b-f11380529d75 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:48.207066 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-67d70e6c-34a6-4e8d-a31b-f11380529d75 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] 10.222.0.87 "GET /compute/v2.1/servers/75ba2733-a6ae-4646-94ba-ad3edc33dc9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052404 Oct 29 01:37:48.208288 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 610/1209] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Oct 29 01:37:48 2021] GET /compute/v2.1/servers/75ba2733-a6ae-4646-94ba-ad3edc33dc9c/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:37:49.222323 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-1f6719ad-7508-46ec-bfe0-7f989c39498c tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:49.225491 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-1f6719ad-7508-46ec-bfe0-7f989c39498c tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] [instance: 75ba2733-a6ae-4646-94ba-ad3edc33dc9c] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:37:49.233290 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-1f6719ad-7508-46ec-bfe0-7f989c39498c tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:49.233751 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-1f6719ad-7508-46ec-bfe0-7f989c39498c tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:49.234562 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-1f6719ad-7508-46ec-bfe0-7f989c39498c tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:49.235006 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-1f6719ad-7508-46ec-bfe0-7f989c39498c tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:49.273702 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-1f6719ad-7508-46ec-bfe0-7f989c39498c tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] 10.222.0.87 "GET /compute/v2.1/servers/75ba2733-a6ae-4646-94ba-ad3edc33dc9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056732 Oct 29 01:37:49.274301 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 600/1210] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Oct 29 01:37:49 2021] GET /compute/v2.1/servers/75ba2733-a6ae-4646-94ba-ad3edc33dc9c/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:37:50.291578 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-08e5c178-a82d-4cf4-9224-3604c45b0e1a tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:50.292494 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-08e5c178-a82d-4cf4-9224-3604c45b0e1a tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] [instance: 75ba2733-a6ae-4646-94ba-ad3edc33dc9c] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:37:50.299419 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-08e5c178-a82d-4cf4-9224-3604c45b0e1a tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:50.299918 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-08e5c178-a82d-4cf4-9224-3604c45b0e1a tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:50.305238 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-08e5c178-a82d-4cf4-9224-3604c45b0e1a tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:50.305238 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-08e5c178-a82d-4cf4-9224-3604c45b0e1a tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:50.334147 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-08e5c178-a82d-4cf4-9224-3604c45b0e1a tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] 10.222.0.87 "GET /compute/v2.1/servers/75ba2733-a6ae-4646-94ba-ad3edc33dc9c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046659 Oct 29 01:37:50.334722 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 611/1211] 10.222.0.87 () {58 vars in 1301 bytes} [Fri Oct 29 01:37:50 2021] GET /compute/v2.1/servers/75ba2733-a6ae-4646-94ba-ad3edc33dc9c/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 01:37:51.695184 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-d678cb22-33ea-42c1-a33f-d5e85095756b tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:51.695761 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-d678cb22-33ea-42c1-a33f-d5e85095756b tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] [instance: 75ba2733-a6ae-4646-94ba-ad3edc33dc9c] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:37:51.702252 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d678cb22-33ea-42c1-a33f-d5e85095756b tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:51.702697 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d678cb22-33ea-42c1-a33f-d5e85095756b tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:51.703475 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d678cb22-33ea-42c1-a33f-d5e85095756b tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:51.703944 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d678cb22-33ea-42c1-a33f-d5e85095756b tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:51.729677 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-d678cb22-33ea-42c1-a33f-d5e85095756b tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] [instance: 75ba2733-a6ae-4646-94ba-ad3edc33dc9c] Going to try to terminate instance {{(pid=116379) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 29 01:37:52.042402 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-d678cb22-33ea-42c1-a33f-d5e85095756b tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] 10.222.0.87 "DELETE /compute/v2.1/servers/75ba2733-a6ae-4646-94ba-ad3edc33dc9c" status: 204 len: 0 microversion: 2.1 time: 0.350570 Oct 29 01:37:52.043023 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 601/1212] 10.222.0.87 () {58 vars in 1238 bytes} [Fri Oct 29 01:37:51 2021] DELETE /compute/v2.1/servers/75ba2733-a6ae-4646-94ba-ad3edc33dc9c => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 01:37:52.051196 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-4c0bf5c5-dcd1-4e42-a924-49f50e5036bf tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:52.051830 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-4c0bf5c5-dcd1-4e42-a924-49f50e5036bf tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] [instance: 75ba2733-a6ae-4646-94ba-ad3edc33dc9c] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:37:52.058043 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4c0bf5c5-dcd1-4e42-a924-49f50e5036bf tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:52.058488 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4c0bf5c5-dcd1-4e42-a924-49f50e5036bf tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:52.059247 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4c0bf5c5-dcd1-4e42-a924-49f50e5036bf tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:52.059674 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4c0bf5c5-dcd1-4e42-a924-49f50e5036bf tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:52.192647 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-4c0bf5c5-dcd1-4e42-a924-49f50e5036bf tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7b600cfde24de9809afe2b55db97cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8778e689b6e42e2b16d49b3fe762ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:52.200411 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-4c0bf5c5-dcd1-4e42-a924-49f50e5036bf tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] 10.222.0.87 "GET /compute/v2.1/servers/75ba2733-a6ae-4646-94ba-ad3edc33dc9c" status: 200 len: 1514 microversion: 2.1 time: 0.153260 Oct 29 01:37:52.200981 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 612/1213] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:37:52 2021] GET /compute/v2.1/servers/75ba2733-a6ae-4646-94ba-ad3edc33dc9c => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:37:53.219157 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-db2df251-9dc8-48b3-963d-e7ff494ddbe5 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:53.219797 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-db2df251-9dc8-48b3-963d-e7ff494ddbe5 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] [instance: 75ba2733-a6ae-4646-94ba-ad3edc33dc9c] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:37:53.226812 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-db2df251-9dc8-48b3-963d-e7ff494ddbe5 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:53.227255 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-db2df251-9dc8-48b3-963d-e7ff494ddbe5 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:53.228069 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-db2df251-9dc8-48b3-963d-e7ff494ddbe5 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:53.228512 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-db2df251-9dc8-48b3-963d-e7ff494ddbe5 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:53.361858 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-db2df251-9dc8-48b3-963d-e7ff494ddbe5 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7b600cfde24de9809afe2b55db97cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8778e689b6e42e2b16d49b3fe762ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:53.370639 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-db2df251-9dc8-48b3-963d-e7ff494ddbe5 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] 10.222.0.87 "GET /compute/v2.1/servers/75ba2733-a6ae-4646-94ba-ad3edc33dc9c" status: 200 len: 1514 microversion: 2.1 time: 0.155547 Oct 29 01:37:53.371249 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 602/1214] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:37:53 2021] GET /compute/v2.1/servers/75ba2733-a6ae-4646-94ba-ad3edc33dc9c => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:37:54.302684 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [req-bef5546d-26f8-4efd-9e4a-30baaadb5026 req-6cf13016-13ec-469b-9f6d-24377fb270bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75ba2733-a6ae-4646-94ba-ad3edc33dc9c", "name": "network-vif-deleted", "tag": "054881ee-300b-4f04-9447-03308c14f3f9"}]} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:37:54.304207 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:37:54.304207 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: warnings.warn(msg) Oct 29 01:37:54.311333 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [req-bef5546d-26f8-4efd-9e4a-30baaadb5026 req-6cf13016-13ec-469b-9f6d-24377fb270bd service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:54.312022 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [req-bef5546d-26f8-4efd-9e4a-30baaadb5026 req-6cf13016-13ec-469b-9f6d-24377fb270bd service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:54.323769 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.compute.server_external_events [req-bef5546d-26f8-4efd-9e4a-30baaadb5026 req-6cf13016-13ec-469b-9f6d-24377fb270bd service nova] Creating event network-vif-deleted:054881ee-300b-4f04-9447-03308c14f3f9 for instance 75ba2733-a6ae-4646-94ba-ad3edc33dc9c on hv-cinder-81398 Oct 29 01:37:54.329478 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [req-bef5546d-26f8-4efd-9e4a-30baaadb5026 req-6cf13016-13ec-469b-9f6d-24377fb270bd service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030775 Oct 29 01:37:54.329673 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 613/1215] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Oct 29 01:37:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:37:54.396381 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-e41df714-4a56-4130-9dee-b3fa024f11e3 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:54.400514 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-e41df714-4a56-4130-9dee-b3fa024f11e3 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] [instance: 75ba2733-a6ae-4646-94ba-ad3edc33dc9c] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:37:54.408924 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-e41df714-4a56-4130-9dee-b3fa024f11e3 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:54.410054 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-e41df714-4a56-4130-9dee-b3fa024f11e3 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:54.411389 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-e41df714-4a56-4130-9dee-b3fa024f11e3 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:54.411878 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-e41df714-4a56-4130-9dee-b3fa024f11e3 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:54.485918 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-e41df714-4a56-4130-9dee-b3fa024f11e3 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7b600cfde24de9809afe2b55db97cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8778e689b6e42e2b16d49b3fe762ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:54.496234 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-e41df714-4a56-4130-9dee-b3fa024f11e3 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] 10.222.0.87 "GET /compute/v2.1/servers/75ba2733-a6ae-4646-94ba-ad3edc33dc9c" status: 200 len: 1472 microversion: 2.1 time: 0.112206 Oct 29 01:37:54.506982 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 603/1216] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:37:54 2021] GET /compute/v2.1/servers/75ba2733-a6ae-4646-94ba-ad3edc33dc9c => generated 1472 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:37:55.514722 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-c936ffd4-fc3a-4dd2-9a74-08a0c505878d tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:55.515435 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-c936ffd4-fc3a-4dd2-9a74-08a0c505878d tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] [instance: 75ba2733-a6ae-4646-94ba-ad3edc33dc9c] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:37:55.521465 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c936ffd4-fc3a-4dd2-9a74-08a0c505878d tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:55.521907 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c936ffd4-fc3a-4dd2-9a74-08a0c505878d tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:55.522671 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c936ffd4-fc3a-4dd2-9a74-08a0c505878d tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:55.523279 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c936ffd4-fc3a-4dd2-9a74-08a0c505878d tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:55.538768 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.wsgi [None req-c936ffd4-fc3a-4dd2-9a74-08a0c505878d tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] HTTP exception thrown: Instance 75ba2733-a6ae-4646-94ba-ad3edc33dc9c could not be found. Oct 29 01:37:55.539373 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-c936ffd4-fc3a-4dd2-9a74-08a0c505878d tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Returning 404 to user: Instance 75ba2733-a6ae-4646-94ba-ad3edc33dc9c could not be found. {{(pid=116378) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:37:55.540272 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-c936ffd4-fc3a-4dd2-9a74-08a0c505878d tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] 10.222.0.87 "GET /compute/v2.1/servers/75ba2733-a6ae-4646-94ba-ad3edc33dc9c" status: 404 len: 111 microversion: 2.1 time: 0.029966 Oct 29 01:37:55.540836 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 614/1217] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:37:55 2021] GET /compute/v2.1/servers/75ba2733-a6ae-4646-94ba-ad3edc33dc9c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:37:56.841950 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-0faf1688-4186-4b08-81ba-1a626bb8b320 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:56.842511 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-0faf1688-4186-4b08-81ba-1a626bb8b320 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] [instance: b6006714-9da6-42de-ac04-ffb4ed8e5949] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:37:56.849000 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-0faf1688-4186-4b08-81ba-1a626bb8b320 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:56.849448 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-0faf1688-4186-4b08-81ba-1a626bb8b320 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:56.850257 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-0faf1688-4186-4b08-81ba-1a626bb8b320 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:56.850689 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-0faf1688-4186-4b08-81ba-1a626bb8b320 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:56.878902 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-0faf1688-4186-4b08-81ba-1a626bb8b320 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] [instance: b6006714-9da6-42de-ac04-ffb4ed8e5949] Going to try to terminate instance {{(pid=116379) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 29 01:37:57.221419 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-0faf1688-4186-4b08-81ba-1a626bb8b320 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] 10.222.0.87 "DELETE /compute/v2.1/servers/b6006714-9da6-42de-ac04-ffb4ed8e5949" status: 204 len: 0 microversion: 2.1 time: 0.382957 Oct 29 01:37:57.222022 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 604/1218] 10.222.0.87 () {58 vars in 1238 bytes} [Fri Oct 29 01:37:56 2021] DELETE /compute/v2.1/servers/b6006714-9da6-42de-ac04-ffb4ed8e5949 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 01:37:57.229757 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-57d8f83f-832e-4c68-9de0-ae2add96e8f4 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:57.230359 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-57d8f83f-832e-4c68-9de0-ae2add96e8f4 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] [instance: b6006714-9da6-42de-ac04-ffb4ed8e5949] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:37:57.236420 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-57d8f83f-832e-4c68-9de0-ae2add96e8f4 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:57.236860 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-57d8f83f-832e-4c68-9de0-ae2add96e8f4 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:57.238171 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-57d8f83f-832e-4c68-9de0-ae2add96e8f4 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:57.239033 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-57d8f83f-832e-4c68-9de0-ae2add96e8f4 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:57.365222 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-57d8f83f-832e-4c68-9de0-ae2add96e8f4 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7b600cfde24de9809afe2b55db97cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8778e689b6e42e2b16d49b3fe762ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:57.372698 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-57d8f83f-832e-4c68-9de0-ae2add96e8f4 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] 10.222.0.87 "GET /compute/v2.1/servers/b6006714-9da6-42de-ac04-ffb4ed8e5949" status: 200 len: 1514 microversion: 2.1 time: 0.146470 Oct 29 01:37:57.373263 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 615/1219] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:37:57 2021] GET /compute/v2.1/servers/b6006714-9da6-42de-ac04-ffb4ed8e5949 => generated 1514 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:37:58.390628 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-83f4f2eb-7702-482d-834b-a78620b7a668 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:58.391408 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-83f4f2eb-7702-482d-834b-a78620b7a668 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] [instance: b6006714-9da6-42de-ac04-ffb4ed8e5949] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:37:58.398461 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-83f4f2eb-7702-482d-834b-a78620b7a668 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:58.398910 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-83f4f2eb-7702-482d-834b-a78620b7a668 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:58.399673 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-83f4f2eb-7702-482d-834b-a78620b7a668 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:58.400133 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-83f4f2eb-7702-482d-834b-a78620b7a668 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:58.525590 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-83f4f2eb-7702-482d-834b-a78620b7a668 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7b600cfde24de9809afe2b55db97cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8778e689b6e42e2b16d49b3fe762ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:58.532909 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-83f4f2eb-7702-482d-834b-a78620b7a668 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] 10.222.0.87 "GET /compute/v2.1/servers/b6006714-9da6-42de-ac04-ffb4ed8e5949" status: 200 len: 1514 microversion: 2.1 time: 0.146291 Oct 29 01:37:58.533503 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 605/1220] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:37:58 2021] GET /compute/v2.1/servers/b6006714-9da6-42de-ac04-ffb4ed8e5949 => generated 1514 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:37:59.569504 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-89ebac95-b638-4fde-b3f4-e774f4f30a78 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:37:59.571684 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-89ebac95-b638-4fde-b3f4-e774f4f30a78 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] [instance: b6006714-9da6-42de-ac04-ffb4ed8e5949] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:37:59.587016 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-89ebac95-b638-4fde-b3f4-e774f4f30a78 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:59.587016 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-89ebac95-b638-4fde-b3f4-e774f4f30a78 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:59.587016 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-89ebac95-b638-4fde-b3f4-e774f4f30a78 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:59.587016 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-89ebac95-b638-4fde-b3f4-e774f4f30a78 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:59.604461 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [req-ef6eb618-feca-45bf-85d0-3f2dbe45a197 req-13b81e54-712f-4bad-b15a-7510c8e84206 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6006714-9da6-42de-ac04-ffb4ed8e5949", "name": "network-vif-deleted", "tag": "d21b1202-4ed9-4ea8-a35b-777bda0c7a2b"}]} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:37:59.606369 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:37:59.606369 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: warnings.warn(msg) Oct 29 01:37:59.618820 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [req-ef6eb618-feca-45bf-85d0-3f2dbe45a197 req-13b81e54-712f-4bad-b15a-7510c8e84206 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:37:59.619219 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [req-ef6eb618-feca-45bf-85d0-3f2dbe45a197 req-13b81e54-712f-4bad-b15a-7510c8e84206 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:37:59.634102 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.compute.server_external_events [req-ef6eb618-feca-45bf-85d0-3f2dbe45a197 req-13b81e54-712f-4bad-b15a-7510c8e84206 service nova] Creating event network-vif-deleted:d21b1202-4ed9-4ea8-a35b-777bda0c7a2b for instance b6006714-9da6-42de-ac04-ffb4ed8e5949 on hv-cinder-81398 Oct 29 01:37:59.640476 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [req-ef6eb618-feca-45bf-85d0-3f2dbe45a197 req-13b81e54-712f-4bad-b15a-7510c8e84206 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046335 Oct 29 01:37:59.641813 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 606/1221] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Oct 29 01:37:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:37:59.699649 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-89ebac95-b638-4fde-b3f4-e774f4f30a78 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7b600cfde24de9809afe2b55db97cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8778e689b6e42e2b16d49b3fe762ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:37:59.709206 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-89ebac95-b638-4fde-b3f4-e774f4f30a78 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] 10.222.0.87 "GET /compute/v2.1/servers/b6006714-9da6-42de-ac04-ffb4ed8e5949" status: 200 len: 1472 microversion: 2.1 time: 0.160394 Oct 29 01:37:59.709787 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 616/1222] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:37:59 2021] GET /compute/v2.1/servers/b6006714-9da6-42de-ac04-ffb4ed8e5949 => generated 1472 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:38:00.728202 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-1e96a274-dfce-4abe-a34f-b178123cce86 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:00.728902 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-1e96a274-dfce-4abe-a34f-b178123cce86 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] [instance: b6006714-9da6-42de-ac04-ffb4ed8e5949] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:38:00.735042 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-1e96a274-dfce-4abe-a34f-b178123cce86 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:00.735489 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-1e96a274-dfce-4abe-a34f-b178123cce86 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:00.736291 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-1e96a274-dfce-4abe-a34f-b178123cce86 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:00.736811 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-1e96a274-dfce-4abe-a34f-b178123cce86 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:00.750912 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.wsgi [None req-1e96a274-dfce-4abe-a34f-b178123cce86 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] HTTP exception thrown: Instance b6006714-9da6-42de-ac04-ffb4ed8e5949 could not be found. Oct 29 01:38:00.751502 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-1e96a274-dfce-4abe-a34f-b178123cce86 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Returning 404 to user: Instance b6006714-9da6-42de-ac04-ffb4ed8e5949 could not be found. {{(pid=116379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:38:00.752368 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-1e96a274-dfce-4abe-a34f-b178123cce86 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] 10.222.0.87 "GET /compute/v2.1/servers/b6006714-9da6-42de-ac04-ffb4ed8e5949" status: 404 len: 111 microversion: 2.1 time: 0.028766 Oct 29 01:38:00.753328 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 607/1223] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:38:00 2021] GET /compute/v2.1/servers/b6006714-9da6-42de-ac04-ffb4ed8e5949 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:38:00.761264 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-3581e583-e02b-4942-97e8-35e68838a6d0 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:00.761812 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-3581e583-e02b-4942-97e8-35e68838a6d0 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] [instance: bb92bdbd-28c2-4c34-9bc2-78bb5165c567] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:38:00.768006 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-3581e583-e02b-4942-97e8-35e68838a6d0 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:00.768449 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-3581e583-e02b-4942-97e8-35e68838a6d0 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:00.769328 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-3581e583-e02b-4942-97e8-35e68838a6d0 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:00.770051 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-3581e583-e02b-4942-97e8-35e68838a6d0 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:00.795532 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-3581e583-e02b-4942-97e8-35e68838a6d0 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] [instance: bb92bdbd-28c2-4c34-9bc2-78bb5165c567] Going to try to terminate instance {{(pid=116378) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 29 01:38:01.125008 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-3581e583-e02b-4942-97e8-35e68838a6d0 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] 10.222.0.87 "DELETE /compute/v2.1/servers/bb92bdbd-28c2-4c34-9bc2-78bb5165c567" status: 204 len: 0 microversion: 2.1 time: 0.367113 Oct 29 01:38:01.125603 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 617/1224] 10.222.0.87 () {58 vars in 1238 bytes} [Fri Oct 29 01:38:00 2021] DELETE /compute/v2.1/servers/bb92bdbd-28c2-4c34-9bc2-78bb5165c567 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:38:01.133400 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-8c1c1ba5-074c-4946-8097-522142aeb6bc tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:01.135565 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-8c1c1ba5-074c-4946-8097-522142aeb6bc tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] [instance: bb92bdbd-28c2-4c34-9bc2-78bb5165c567] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:38:01.140343 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-8c1c1ba5-074c-4946-8097-522142aeb6bc tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:01.140772 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-8c1c1ba5-074c-4946-8097-522142aeb6bc tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:01.141535 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-8c1c1ba5-074c-4946-8097-522142aeb6bc tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:01.141962 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-8c1c1ba5-074c-4946-8097-522142aeb6bc tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:01.269692 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-8c1c1ba5-074c-4946-8097-522142aeb6bc tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7b600cfde24de9809afe2b55db97cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8778e689b6e42e2b16d49b3fe762ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:01.277473 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-8c1c1ba5-074c-4946-8097-522142aeb6bc tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] 10.222.0.87 "GET /compute/v2.1/servers/bb92bdbd-28c2-4c34-9bc2-78bb5165c567" status: 200 len: 1515 microversion: 2.1 time: 0.147719 Oct 29 01:38:01.278052 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 608/1225] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:38:01 2021] GET /compute/v2.1/servers/bb92bdbd-28c2-4c34-9bc2-78bb5165c567 => generated 1515 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:38:02.295289 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-937033fa-ee51-4152-bad6-91e071f291ee tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:02.296053 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-937033fa-ee51-4152-bad6-91e071f291ee tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] [instance: bb92bdbd-28c2-4c34-9bc2-78bb5165c567] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:38:02.302961 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-937033fa-ee51-4152-bad6-91e071f291ee tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:02.303417 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-937033fa-ee51-4152-bad6-91e071f291ee tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:02.304229 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-937033fa-ee51-4152-bad6-91e071f291ee tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:02.304667 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-937033fa-ee51-4152-bad6-91e071f291ee tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:02.435502 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-937033fa-ee51-4152-bad6-91e071f291ee tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7b600cfde24de9809afe2b55db97cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8778e689b6e42e2b16d49b3fe762ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:02.444240 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-937033fa-ee51-4152-bad6-91e071f291ee tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] 10.222.0.87 "GET /compute/v2.1/servers/bb92bdbd-28c2-4c34-9bc2-78bb5165c567" status: 200 len: 1515 microversion: 2.1 time: 0.152967 Oct 29 01:38:02.444845 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 618/1226] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:38:02 2021] GET /compute/v2.1/servers/bb92bdbd-28c2-4c34-9bc2-78bb5165c567 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:38:03.192762 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [req-5e846e16-69b2-4d17-b7c2-68d1492485f9 req-c147e914-5351-4d97-ba75-7c85e361f30d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb92bdbd-28c2-4c34-9bc2-78bb5165c567", "name": "network-vif-deleted", "tag": "bc186c4d-5060-45ec-81fa-6d90f5ac14d9"}]} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:38:03.195354 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:38:03.195354 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: warnings.warn(msg) Oct 29 01:38:03.203334 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [req-5e846e16-69b2-4d17-b7c2-68d1492485f9 req-c147e914-5351-4d97-ba75-7c85e361f30d service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:03.203927 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [req-5e846e16-69b2-4d17-b7c2-68d1492485f9 req-c147e914-5351-4d97-ba75-7c85e361f30d service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:03.217233 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.compute.server_external_events [req-5e846e16-69b2-4d17-b7c2-68d1492485f9 req-c147e914-5351-4d97-ba75-7c85e361f30d service nova] Creating event network-vif-deleted:bc186c4d-5060-45ec-81fa-6d90f5ac14d9 for instance bb92bdbd-28c2-4c34-9bc2-78bb5165c567 on hv-cinder-81398 Oct 29 01:38:03.223000 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [req-5e846e16-69b2-4d17-b7c2-68d1492485f9 req-c147e914-5351-4d97-ba75-7c85e361f30d service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035182 Oct 29 01:38:03.223883 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 609/1227] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Oct 29 01:38:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:38:03.462245 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-163f2dd9-2ab1-468d-b4ea-e4f37254d1c4 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:03.463363 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-163f2dd9-2ab1-468d-b4ea-e4f37254d1c4 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] [instance: bb92bdbd-28c2-4c34-9bc2-78bb5165c567] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:38:03.474593 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-163f2dd9-2ab1-468d-b4ea-e4f37254d1c4 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:03.474593 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-163f2dd9-2ab1-468d-b4ea-e4f37254d1c4 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:03.474593 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-163f2dd9-2ab1-468d-b4ea-e4f37254d1c4 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:03.474593 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-163f2dd9-2ab1-468d-b4ea-e4f37254d1c4 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:03.553275 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-163f2dd9-2ab1-468d-b4ea-e4f37254d1c4 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7b600cfde24de9809afe2b55db97cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8778e689b6e42e2b16d49b3fe762ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:03.560907 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-163f2dd9-2ab1-468d-b4ea-e4f37254d1c4 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] 10.222.0.87 "GET /compute/v2.1/servers/bb92bdbd-28c2-4c34-9bc2-78bb5165c567" status: 200 len: 1303 microversion: 2.1 time: 0.102408 Oct 29 01:38:03.561483 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 619/1228] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:38:03 2021] GET /compute/v2.1/servers/bb92bdbd-28c2-4c34-9bc2-78bb5165c567 => generated 1303 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:38:04.587469 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-28beb0a1-9173-4251-95a5-e3b86d88694c tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:04.588200 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-28beb0a1-9173-4251-95a5-e3b86d88694c tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] [instance: bb92bdbd-28c2-4c34-9bc2-78bb5165c567] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:38:04.594348 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-28beb0a1-9173-4251-95a5-e3b86d88694c tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:04.594796 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-28beb0a1-9173-4251-95a5-e3b86d88694c tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:04.595571 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-28beb0a1-9173-4251-95a5-e3b86d88694c tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:04.596041 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-28beb0a1-9173-4251-95a5-e3b86d88694c tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:04.610025 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.wsgi [None req-28beb0a1-9173-4251-95a5-e3b86d88694c tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] HTTP exception thrown: Instance bb92bdbd-28c2-4c34-9bc2-78bb5165c567 could not be found. Oct 29 01:38:04.610619 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-28beb0a1-9173-4251-95a5-e3b86d88694c tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Returning 404 to user: Instance bb92bdbd-28c2-4c34-9bc2-78bb5165c567 could not be found. {{(pid=116379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:38:04.611483 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-28beb0a1-9173-4251-95a5-e3b86d88694c tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] 10.222.0.87 "GET /compute/v2.1/servers/bb92bdbd-28c2-4c34-9bc2-78bb5165c567" status: 404 len: 111 microversion: 2.1 time: 0.028486 Oct 29 01:38:04.612662 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 610/1229] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:38:04 2021] GET /compute/v2.1/servers/bb92bdbd-28c2-4c34-9bc2-78bb5165c567 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:38:05.922328 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-03955af3-06b5-4a2a-9a77-524c3cae59b8 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:05.922943 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-03955af3-06b5-4a2a-9a77-524c3cae59b8 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] [instance: e680bc8b-1a56-4a4f-b1aa-fd79a9e98da8] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:38:05.930166 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-03955af3-06b5-4a2a-9a77-524c3cae59b8 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:05.930740 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-03955af3-06b5-4a2a-9a77-524c3cae59b8 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:05.931842 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-03955af3-06b5-4a2a-9a77-524c3cae59b8 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:05.932639 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-03955af3-06b5-4a2a-9a77-524c3cae59b8 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:05.961066 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-03955af3-06b5-4a2a-9a77-524c3cae59b8 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] [instance: e680bc8b-1a56-4a4f-b1aa-fd79a9e98da8] Going to try to terminate instance {{(pid=116378) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 29 01:38:06.390744 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-03955af3-06b5-4a2a-9a77-524c3cae59b8 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] 10.222.0.87 "DELETE /compute/v2.1/servers/e680bc8b-1a56-4a4f-b1aa-fd79a9e98da8" status: 204 len: 0 microversion: 2.1 time: 0.473232 Oct 29 01:38:06.391512 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 620/1230] 10.222.0.87 () {58 vars in 1238 bytes} [Fri Oct 29 01:38:05 2021] DELETE /compute/v2.1/servers/e680bc8b-1a56-4a4f-b1aa-fd79a9e98da8 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:38:06.400463 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-60408882-c878-4942-8cd6-707f44499b17 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:06.401054 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-60408882-c878-4942-8cd6-707f44499b17 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] [instance: e680bc8b-1a56-4a4f-b1aa-fd79a9e98da8] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:38:06.407569 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-60408882-c878-4942-8cd6-707f44499b17 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:06.408068 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-60408882-c878-4942-8cd6-707f44499b17 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:06.408880 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-60408882-c878-4942-8cd6-707f44499b17 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:06.413090 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-60408882-c878-4942-8cd6-707f44499b17 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:06.560046 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-60408882-c878-4942-8cd6-707f44499b17 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7b600cfde24de9809afe2b55db97cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8778e689b6e42e2b16d49b3fe762ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:06.568698 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-60408882-c878-4942-8cd6-707f44499b17 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] 10.222.0.87 "GET /compute/v2.1/servers/e680bc8b-1a56-4a4f-b1aa-fd79a9e98da8" status: 200 len: 1515 microversion: 2.1 time: 0.171873 Oct 29 01:38:06.569282 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 611/1231] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:38:06 2021] GET /compute/v2.1/servers/e680bc8b-1a56-4a4f-b1aa-fd79a9e98da8 => generated 1515 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:38:07.587145 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-e9855a19-987b-4779-80d6-4e698f08289b tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:07.587963 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-e9855a19-987b-4779-80d6-4e698f08289b tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] [instance: e680bc8b-1a56-4a4f-b1aa-fd79a9e98da8] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:38:07.594681 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-e9855a19-987b-4779-80d6-4e698f08289b tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:07.595136 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-e9855a19-987b-4779-80d6-4e698f08289b tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:07.596095 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-e9855a19-987b-4779-80d6-4e698f08289b tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:07.597078 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-e9855a19-987b-4779-80d6-4e698f08289b tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:07.741593 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-e9855a19-987b-4779-80d6-4e698f08289b tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7b600cfde24de9809afe2b55db97cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8778e689b6e42e2b16d49b3fe762ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:07.749024 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-e9855a19-987b-4779-80d6-4e698f08289b tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] 10.222.0.87 "GET /compute/v2.1/servers/e680bc8b-1a56-4a4f-b1aa-fd79a9e98da8" status: 200 len: 1515 microversion: 2.1 time: 0.166176 Oct 29 01:38:07.749583 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 621/1232] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:38:07 2021] GET /compute/v2.1/servers/e680bc8b-1a56-4a4f-b1aa-fd79a9e98da8 => generated 1515 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:38:08.776150 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-73f22c7f-2152-4948-9a3d-2f33a4f201c8 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:08.776850 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-73f22c7f-2152-4948-9a3d-2f33a4f201c8 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] [instance: e680bc8b-1a56-4a4f-b1aa-fd79a9e98da8] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:38:08.789930 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-73f22c7f-2152-4948-9a3d-2f33a4f201c8 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:08.790373 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-73f22c7f-2152-4948-9a3d-2f33a4f201c8 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:08.791183 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-73f22c7f-2152-4948-9a3d-2f33a4f201c8 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:08.792908 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-73f22c7f-2152-4948-9a3d-2f33a4f201c8 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:08.824837 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [req-c1bfacd9-3f8c-4c1a-8af6-61bc279558c1 req-c3e48cce-b68a-417f-b984-904cf1369c2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e680bc8b-1a56-4a4f-b1aa-fd79a9e98da8", "name": "network-vif-deleted", "tag": "4ed04aff-6179-4c33-bfce-b78bc0ab0759"}]} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:38:08.826375 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:38:08.826375 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: warnings.warn(msg) Oct 29 01:38:08.835606 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [req-c1bfacd9-3f8c-4c1a-8af6-61bc279558c1 req-c3e48cce-b68a-417f-b984-904cf1369c2b service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:08.836611 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [req-c1bfacd9-3f8c-4c1a-8af6-61bc279558c1 req-c3e48cce-b68a-417f-b984-904cf1369c2b service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:08.848894 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.compute.server_external_events [req-c1bfacd9-3f8c-4c1a-8af6-61bc279558c1 req-c3e48cce-b68a-417f-b984-904cf1369c2b service nova] Creating event network-vif-deleted:4ed04aff-6179-4c33-bfce-b78bc0ab0759 for instance e680bc8b-1a56-4a4f-b1aa-fd79a9e98da8 on hv-cinder-81398 Oct 29 01:38:08.853841 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [req-c1bfacd9-3f8c-4c1a-8af6-61bc279558c1 req-c3e48cce-b68a-417f-b984-904cf1369c2b service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032537 Oct 29 01:38:08.854695 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 622/1233] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Oct 29 01:38:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:38:08.868195 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-73f22c7f-2152-4948-9a3d-2f33a4f201c8 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7b600cfde24de9809afe2b55db97cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8778e689b6e42e2b16d49b3fe762ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:08.877870 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-73f22c7f-2152-4948-9a3d-2f33a4f201c8 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] 10.222.0.87 "GET /compute/v2.1/servers/e680bc8b-1a56-4a4f-b1aa-fd79a9e98da8" status: 200 len: 1473 microversion: 2.1 time: 0.115005 Oct 29 01:38:08.878460 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 612/1234] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:38:08 2021] GET /compute/v2.1/servers/e680bc8b-1a56-4a4f-b1aa-fd79a9e98da8 => generated 1473 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:38:09.895911 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-7a71a1de-dbeb-4ab1-97e2-c1e5bef0bbb6 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:09.896612 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-7a71a1de-dbeb-4ab1-97e2-c1e5bef0bbb6 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] [instance: e680bc8b-1a56-4a4f-b1aa-fd79a9e98da8] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:38:09.902776 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-7a71a1de-dbeb-4ab1-97e2-c1e5bef0bbb6 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:09.903225 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-7a71a1de-dbeb-4ab1-97e2-c1e5bef0bbb6 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:09.904071 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-7a71a1de-dbeb-4ab1-97e2-c1e5bef0bbb6 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:09.904507 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-7a71a1de-dbeb-4ab1-97e2-c1e5bef0bbb6 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:09.939394 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-7a71a1de-dbeb-4ab1-97e2-c1e5bef0bbb6 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:09.939922 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-7a71a1de-dbeb-4ab1-97e2-c1e5bef0bbb6 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:09.940392 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.objects.instance [None req-7a71a1de-dbeb-4ab1-97e2-c1e5bef0bbb6 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lazy-loading 'fault' on Instance uuid e680bc8b-1a56-4a4f-b1aa-fd79a9e98da8 {{(pid=116378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 01:38:09.981109 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-7a71a1de-dbeb-4ab1-97e2-c1e5bef0bbb6 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7b600cfde24de9809afe2b55db97cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8778e689b6e42e2b16d49b3fe762ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:09.989689 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-7a71a1de-dbeb-4ab1-97e2-c1e5bef0bbb6 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] 10.222.0.87 "GET /compute/v2.1/servers/e680bc8b-1a56-4a4f-b1aa-fd79a9e98da8" status: 200 len: 1308 microversion: 2.1 time: 0.098944 Oct 29 01:38:09.990260 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 623/1235] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:38:09 2021] GET /compute/v2.1/servers/e680bc8b-1a56-4a4f-b1aa-fd79a9e98da8 => generated 1308 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:38:11.007204 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-3d8cdb81-beec-4cf3-9699-75e832262ea0 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:11.007869 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-3d8cdb81-beec-4cf3-9699-75e832262ea0 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] [instance: e680bc8b-1a56-4a4f-b1aa-fd79a9e98da8] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:38:11.014804 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-3d8cdb81-beec-4cf3-9699-75e832262ea0 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:11.015368 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-3d8cdb81-beec-4cf3-9699-75e832262ea0 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:11.016179 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-3d8cdb81-beec-4cf3-9699-75e832262ea0 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:11.016617 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-3d8cdb81-beec-4cf3-9699-75e832262ea0 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:11.060701 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-3d8cdb81-beec-4cf3-9699-75e832262ea0 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:11.061143 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-3d8cdb81-beec-4cf3-9699-75e832262ea0 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:11.061599 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.objects.instance [None req-3d8cdb81-beec-4cf3-9699-75e832262ea0 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lazy-loading 'fault' on Instance uuid e680bc8b-1a56-4a4f-b1aa-fd79a9e98da8 {{(pid=116379) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 01:38:11.126325 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-3d8cdb81-beec-4cf3-9699-75e832262ea0 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7b600cfde24de9809afe2b55db97cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8778e689b6e42e2b16d49b3fe762ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:11.134325 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-3d8cdb81-beec-4cf3-9699-75e832262ea0 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] 10.222.0.87 "GET /compute/v2.1/servers/e680bc8b-1a56-4a4f-b1aa-fd79a9e98da8" status: 200 len: 1308 microversion: 2.1 time: 0.131685 Oct 29 01:38:11.134911 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 613/1236] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:38:11 2021] GET /compute/v2.1/servers/e680bc8b-1a56-4a4f-b1aa-fd79a9e98da8 => generated 1308 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:38:11.677640 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-ed6cacb9-2217-4ff0-870f-ee6ecc547da0 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:11.678162 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-ed6cacb9-2217-4ff0-870f-ee6ecc547da0 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] [instance: 58f3409d-cd2a-4bef-9ae4-2fba782b321f] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:38:11.680026 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [req-5008aa0a-f283-455b-9955-a9c9ccaab67e req-2133ad98-98a9-4cff-a095-a0a551628cc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58f3409d-cd2a-4bef-9ae4-2fba782b321f", "tag": "b9061b77-a5c8-4ac6-9f65-0f8712ee20cf"}]} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:38:11.681709 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:38:11.681709 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: warnings.warn(msg) Oct 29 01:38:11.684988 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ed6cacb9-2217-4ff0-870f-ee6ecc547da0 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:11.685772 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ed6cacb9-2217-4ff0-870f-ee6ecc547da0 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:11.686545 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ed6cacb9-2217-4ff0-870f-ee6ecc547da0 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:11.686966 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ed6cacb9-2217-4ff0-870f-ee6ecc547da0 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:11.689024 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [req-5008aa0a-f283-455b-9955-a9c9ccaab67e req-2133ad98-98a9-4cff-a095-a0a551628cc8 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:11.689722 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [req-5008aa0a-f283-455b-9955-a9c9ccaab67e req-2133ad98-98a9-4cff-a095-a0a551628cc8 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:11.701939 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.compute.server_external_events [req-5008aa0a-f283-455b-9955-a9c9ccaab67e req-2133ad98-98a9-4cff-a095-a0a551628cc8 service nova] Creating event network-changed:b9061b77-a5c8-4ac6-9f65-0f8712ee20cf for instance 58f3409d-cd2a-4bef-9ae4-2fba782b321f on hv-cinder-81398 Oct 29 01:38:11.708332 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [req-5008aa0a-f283-455b-9955-a9c9ccaab67e req-2133ad98-98a9-4cff-a095-a0a551628cc8 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031919 Oct 29 01:38:11.709335 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 614/1237] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Oct 29 01:38:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:38:11.716077 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-ed6cacb9-2217-4ff0-870f-ee6ecc547da0 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] [instance: 58f3409d-cd2a-4bef-9ae4-2fba782b321f] Going to try to terminate instance {{(pid=116378) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 29 01:38:12.032956 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-ed6cacb9-2217-4ff0-870f-ee6ecc547da0 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] 10.222.0.87 "DELETE /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f" status: 204 len: 0 microversion: 2.1 time: 0.359021 Oct 29 01:38:12.033427 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 624/1238] 10.222.0.87 () {58 vars in 1238 bytes} [Fri Oct 29 01:38:11 2021] DELETE /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:38:12.042506 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-85fd6c59-5083-4e57-b417-b1cfb5a32f86 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:12.043279 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-85fd6c59-5083-4e57-b417-b1cfb5a32f86 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] [instance: 58f3409d-cd2a-4bef-9ae4-2fba782b321f] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:38:12.050078 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-85fd6c59-5083-4e57-b417-b1cfb5a32f86 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:12.050518 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-85fd6c59-5083-4e57-b417-b1cfb5a32f86 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:12.051474 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-85fd6c59-5083-4e57-b417-b1cfb5a32f86 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:12.051926 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-85fd6c59-5083-4e57-b417-b1cfb5a32f86 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:12.152374 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-dbffb9a7-27a6-49d2-a38b-613f76210fc9 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:12.153253 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-dbffb9a7-27a6-49d2-a38b-613f76210fc9 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] [instance: e680bc8b-1a56-4a4f-b1aa-fd79a9e98da8] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:38:12.160407 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-dbffb9a7-27a6-49d2-a38b-613f76210fc9 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:12.161003 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-dbffb9a7-27a6-49d2-a38b-613f76210fc9 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:12.161928 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-dbffb9a7-27a6-49d2-a38b-613f76210fc9 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:12.162463 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-dbffb9a7-27a6-49d2-a38b-613f76210fc9 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:12.188311 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-85fd6c59-5083-4e57-b417-b1cfb5a32f86 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c50a525003e427ba5ff9dea8f4ed47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0db42704249b29fba70abbda7991c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:12.199424 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-85fd6c59-5083-4e57-b417-b1cfb5a32f86 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] 10.222.0.87 "GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f" status: 200 len: 1570 microversion: 2.1 time: 0.161242 Oct 29 01:38:12.208053 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 615/1239] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:38:12 2021] GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f => generated 1570 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:38:12.213868 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-dbffb9a7-27a6-49d2-a38b-613f76210fc9 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:12.214547 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-dbffb9a7-27a6-49d2-a38b-613f76210fc9 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:12.215168 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.objects.instance [None req-dbffb9a7-27a6-49d2-a38b-613f76210fc9 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lazy-loading 'fault' on Instance uuid e680bc8b-1a56-4a4f-b1aa-fd79a9e98da8 {{(pid=116378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 01:38:12.261965 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-dbffb9a7-27a6-49d2-a38b-613f76210fc9 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c7b600cfde24de9809afe2b55db97cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8778e689b6e42e2b16d49b3fe762ac6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:12.269664 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-dbffb9a7-27a6-49d2-a38b-613f76210fc9 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] 10.222.0.87 "GET /compute/v2.1/servers/e680bc8b-1a56-4a4f-b1aa-fd79a9e98da8" status: 200 len: 1308 microversion: 2.1 time: 0.121206 Oct 29 01:38:12.273151 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 625/1240] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:38:12 2021] GET /compute/v2.1/servers/e680bc8b-1a56-4a4f-b1aa-fd79a9e98da8 => generated 1308 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:38:13.226631 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-9596582a-a409-4aff-87b2-f83a1e6bef06 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:13.227256 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-9596582a-a409-4aff-87b2-f83a1e6bef06 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] [instance: 58f3409d-cd2a-4bef-9ae4-2fba782b321f] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:38:13.233933 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-9596582a-a409-4aff-87b2-f83a1e6bef06 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:13.234395 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-9596582a-a409-4aff-87b2-f83a1e6bef06 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:13.235197 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-9596582a-a409-4aff-87b2-f83a1e6bef06 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:13.235634 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-9596582a-a409-4aff-87b2-f83a1e6bef06 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:13.288741 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-b04fa299-f419-47bc-99b1-fb7c9a87cbb5 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:13.289369 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-b04fa299-f419-47bc-99b1-fb7c9a87cbb5 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] [instance: e680bc8b-1a56-4a4f-b1aa-fd79a9e98da8] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:38:13.295962 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-b04fa299-f419-47bc-99b1-fb7c9a87cbb5 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:13.296584 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-b04fa299-f419-47bc-99b1-fb7c9a87cbb5 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:13.297483 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-b04fa299-f419-47bc-99b1-fb7c9a87cbb5 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:13.297791 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-b04fa299-f419-47bc-99b1-fb7c9a87cbb5 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:13.314176 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.wsgi [None req-b04fa299-f419-47bc-99b1-fb7c9a87cbb5 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] HTTP exception thrown: Instance e680bc8b-1a56-4a4f-b1aa-fd79a9e98da8 could not be found. Oct 29 01:38:13.314852 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-b04fa299-f419-47bc-99b1-fb7c9a87cbb5 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] Returning 404 to user: Instance e680bc8b-1a56-4a4f-b1aa-fd79a9e98da8 could not be found. {{(pid=116378) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:38:13.315759 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-b04fa299-f419-47bc-99b1-fb7c9a87cbb5 tempest-AttachVolumeNegativeTest-547732164 tempest-AttachVolumeNegativeTest-547732164-project] 10.222.0.87 "GET /compute/v2.1/servers/e680bc8b-1a56-4a4f-b1aa-fd79a9e98da8" status: 404 len: 111 microversion: 2.1 time: 0.032122 Oct 29 01:38:13.316333 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 626/1241] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:38:13 2021] GET /compute/v2.1/servers/e680bc8b-1a56-4a4f-b1aa-fd79a9e98da8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 01:38:13.378849 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-9596582a-a409-4aff-87b2-f83a1e6bef06 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c50a525003e427ba5ff9dea8f4ed47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0db42704249b29fba70abbda7991c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:13.387350 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-9596582a-a409-4aff-87b2-f83a1e6bef06 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] 10.222.0.87 "GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f" status: 200 len: 1451 microversion: 2.1 time: 0.165062 Oct 29 01:38:13.388541 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 616/1242] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:38:13 2021] GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f => generated 1451 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:38:14.407578 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-25020df1-a9e6-45e5-a216-becb968c6020 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:14.408230 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-25020df1-a9e6-45e5-a216-becb968c6020 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] [instance: 58f3409d-cd2a-4bef-9ae4-2fba782b321f] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:38:14.415138 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-25020df1-a9e6-45e5-a216-becb968c6020 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:14.415517 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-25020df1-a9e6-45e5-a216-becb968c6020 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:14.416318 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-25020df1-a9e6-45e5-a216-becb968c6020 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:14.416753 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-25020df1-a9e6-45e5-a216-becb968c6020 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:14.515954 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-25020df1-a9e6-45e5-a216-becb968c6020 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c50a525003e427ba5ff9dea8f4ed47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0db42704249b29fba70abbda7991c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:14.519764 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-25020df1-a9e6-45e5-a216-becb968c6020 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] 10.222.0.87 "GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f" status: 200 len: 1383 microversion: 2.1 time: 0.115881 Oct 29 01:38:14.529936 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 627/1243] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:38:14 2021] GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f => generated 1383 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:38:14.548386 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [req-21ca471d-ad62-43f1-95dd-a17ae13023e9 req-cfa61482-7f74-423a-af70-f76b2e8a1fb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58f3409d-cd2a-4bef-9ae4-2fba782b321f", "name": "network-vif-deleted", "tag": "b9061b77-a5c8-4ac6-9f65-0f8712ee20cf"}]} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:38:14.550601 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:38:14.550601 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: warnings.warn(msg) Oct 29 01:38:14.558067 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [req-21ca471d-ad62-43f1-95dd-a17ae13023e9 req-cfa61482-7f74-423a-af70-f76b2e8a1fb1 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:14.558511 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [req-21ca471d-ad62-43f1-95dd-a17ae13023e9 req-cfa61482-7f74-423a-af70-f76b2e8a1fb1 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:14.570994 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.compute.server_external_events [req-21ca471d-ad62-43f1-95dd-a17ae13023e9 req-cfa61482-7f74-423a-af70-f76b2e8a1fb1 service nova] Creating event network-vif-deleted:b9061b77-a5c8-4ac6-9f65-0f8712ee20cf for instance 58f3409d-cd2a-4bef-9ae4-2fba782b321f on hv-cinder-81398 Oct 29 01:38:14.577503 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [req-21ca471d-ad62-43f1-95dd-a17ae13023e9 req-cfa61482-7f74-423a-af70-f76b2e8a1fb1 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032729 Oct 29 01:38:14.578147 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 617/1244] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Oct 29 01:38:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:38:15.537556 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-c4e23a42-81bb-4ef8-b922-0ab1f6a54fee tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:15.538175 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-c4e23a42-81bb-4ef8-b922-0ab1f6a54fee tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] [instance: 58f3409d-cd2a-4bef-9ae4-2fba782b321f] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:38:15.545323 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c4e23a42-81bb-4ef8-b922-0ab1f6a54fee tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:15.545767 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c4e23a42-81bb-4ef8-b922-0ab1f6a54fee tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:15.546648 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c4e23a42-81bb-4ef8-b922-0ab1f6a54fee tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:15.547074 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c4e23a42-81bb-4ef8-b922-0ab1f6a54fee tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:15.616243 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-c4e23a42-81bb-4ef8-b922-0ab1f6a54fee tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c50a525003e427ba5ff9dea8f4ed47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0db42704249b29fba70abbda7991c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:15.623621 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-c4e23a42-81bb-4ef8-b922-0ab1f6a54fee tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] 10.222.0.87 "GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f" status: 200 len: 1383 microversion: 2.1 time: 0.089851 Oct 29 01:38:15.624230 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 628/1245] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:38:15 2021] GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f => generated 1383 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:38:16.642556 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-9043ea19-3a26-4119-95bc-b05d5e53bc2d tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:16.643876 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-9043ea19-3a26-4119-95bc-b05d5e53bc2d tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] [instance: 58f3409d-cd2a-4bef-9ae4-2fba782b321f] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:38:16.650362 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-9043ea19-3a26-4119-95bc-b05d5e53bc2d tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:16.650801 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-9043ea19-3a26-4119-95bc-b05d5e53bc2d tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:16.651584 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-9043ea19-3a26-4119-95bc-b05d5e53bc2d tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:16.652061 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-9043ea19-3a26-4119-95bc-b05d5e53bc2d tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:16.720444 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-9043ea19-3a26-4119-95bc-b05d5e53bc2d tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c50a525003e427ba5ff9dea8f4ed47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0db42704249b29fba70abbda7991c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:16.728918 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-9043ea19-3a26-4119-95bc-b05d5e53bc2d tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] 10.222.0.87 "GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f" status: 200 len: 1383 microversion: 2.1 time: 0.090466 Oct 29 01:38:16.729566 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 618/1246] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:38:16 2021] GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f => generated 1383 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:38:17.750603 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-556ebde2-b2b2-4496-a6dd-d30293abcf4f tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:17.751432 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-556ebde2-b2b2-4496-a6dd-d30293abcf4f tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] [instance: 58f3409d-cd2a-4bef-9ae4-2fba782b321f] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:38:17.759390 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-556ebde2-b2b2-4496-a6dd-d30293abcf4f tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:17.759886 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-556ebde2-b2b2-4496-a6dd-d30293abcf4f tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:17.760799 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-556ebde2-b2b2-4496-a6dd-d30293abcf4f tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:17.761235 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-556ebde2-b2b2-4496-a6dd-d30293abcf4f tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:17.810066 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-556ebde2-b2b2-4496-a6dd-d30293abcf4f tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:17.810529 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-556ebde2-b2b2-4496-a6dd-d30293abcf4f tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:17.810988 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.objects.instance [None req-556ebde2-b2b2-4496-a6dd-d30293abcf4f tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lazy-loading 'fault' on Instance uuid 58f3409d-cd2a-4bef-9ae4-2fba782b321f {{(pid=116378) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 01:38:17.860300 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-556ebde2-b2b2-4496-a6dd-d30293abcf4f tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c50a525003e427ba5ff9dea8f4ed47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0db42704249b29fba70abbda7991c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:38:17.881102 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-556ebde2-b2b2-4496-a6dd-d30293abcf4f tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] 10.222.0.87 "GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f" status: 200 len: 1225 microversion: 2.1 time: 0.133764 Oct 29 01:38:17.882224 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 629/1247] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:38:17 2021] GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f => generated 1225 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:38:18.905421 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-d1d8997f-c9f3-4ed5-a964-e066221a4285 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:18.906291 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-d1d8997f-c9f3-4ed5-a964-e066221a4285 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] [instance: 58f3409d-cd2a-4bef-9ae4-2fba782b321f] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:38:18.914673 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d1d8997f-c9f3-4ed5-a964-e066221a4285 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:18.915137 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d1d8997f-c9f3-4ed5-a964-e066221a4285 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:18.915967 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d1d8997f-c9f3-4ed5-a964-e066221a4285 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:38:18.916419 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d1d8997f-c9f3-4ed5-a964-e066221a4285 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:38:18.933042 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.wsgi [None req-d1d8997f-c9f3-4ed5-a964-e066221a4285 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] HTTP exception thrown: Instance 58f3409d-cd2a-4bef-9ae4-2fba782b321f could not be found. Oct 29 01:38:18.933657 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-d1d8997f-c9f3-4ed5-a964-e066221a4285 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Returning 404 to user: Instance 58f3409d-cd2a-4bef-9ae4-2fba782b321f could not be found. {{(pid=116379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:38:18.934517 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-d1d8997f-c9f3-4ed5-a964-e066221a4285 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] 10.222.0.87 "GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f" status: 404 len: 111 microversion: 2.1 time: 0.033249 Oct 29 01:38:18.935094 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 619/1248] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:38:18 2021] GET /compute/v2.1/servers/58f3409d-cd2a-4bef-9ae4-2fba782b321f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 01:38:19.282790 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-8faabe0e-8513-4fc2-bda3-65ca650402d2 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] Calling method '.version_select at 0x7ff62c0953a0>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:38:19.384213 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-8faabe0e-8513-4fc2-bda3-65ca650402d2 tempest-TestShelveInstance-768927087 tempest-TestShelveInstance-768927087-project] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1259817571" status: 202 len: 0 microversion: 2.1 time: 0.110160 Oct 29 01:38:19.385112 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 630/1249] 10.222.0.87 () {58 vars in 1253 bytes} [Fri Oct 29 01:38:19 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1259817571 => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:39:01.855161 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-a2de3988-a8c5-4a01-8f29-0b57d008ec6f tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1427423055", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1481000100", "security_groups": [{"name": "tempest-secgroup-smoke-1031308803"}], "block_device_mapping_v2": [{"uuid": "53e415ce-bd4b-4a6f-bf8f-2f91700b528b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b37af5eb-5268-42f9-a4b9-3756fed9194f"}]}} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:39:01.956059 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.network.neutron [None req-a2de3988-a8c5-4a01-8f29-0b57d008ec6f tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] validate_networks() for [('b37af5eb-5268-42f9-a4b9-3756fed9194f', None, None, None, None, None)] {{(pid=116379) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 29 01:39:02.342541 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.virt.hardware [None req-a2de3988-a8c5-4a01-8f29-0b57d008ec6f tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Flavor limits 0:0:0 {{(pid=116379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 01:39:02.342989 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.virt.hardware [None req-a2de3988-a8c5-4a01-8f29-0b57d008ec6f tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Image limits 0:0:0 {{(pid=116379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 01:39:02.343478 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.virt.hardware [None req-a2de3988-a8c5-4a01-8f29-0b57d008ec6f tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Flavor pref 0:0:0 {{(pid=116379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 01:39:02.343923 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.virt.hardware [None req-a2de3988-a8c5-4a01-8f29-0b57d008ec6f tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Image pref 0:0:0 {{(pid=116379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 01:39:02.344334 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.virt.hardware [None req-a2de3988-a8c5-4a01-8f29-0b57d008ec6f tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116379) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 01:39:02.353805 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-a2de3988-a8c5-4a01-8f29-0b57d008ec6f tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:39:02.354253 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-a2de3988-a8c5-4a01-8f29-0b57d008ec6f tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:39:02.355074 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-a2de3988-a8c5-4a01-8f29-0b57d008ec6f tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:39:02.355539 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-a2de3988-a8c5-4a01-8f29-0b57d008ec6f tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:39:02.372766 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.quota [None req-a2de3988-a8c5-4a01-8f29-0b57d008ec6f tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Getting quotas for project 84bceeeb4f67456a90779360ffc620aa. Resources: {'instances', 'cores', 'ram'} {{(pid=116379) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 01:39:02.376519 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.quota [None req-a2de3988-a8c5-4a01-8f29-0b57d008ec6f tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Getting quotas for user bef8571ef39b4efe8f510a28052e2b6f and project 84bceeeb4f67456a90779360ffc620aa. Resources: {'instances', 'cores', 'ram'} {{(pid=116379) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 01:39:02.432554 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-a2de3988-a8c5-4a01-8f29-0b57d008ec6f tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Going to run 1 instances... {{(pid=116379) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 29 01:39:02.434752 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-a2de3988-a8c5-4a01-8f29-0b57d008ec6f tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] [instance: a4afd50f-8af5-4a24-9636-525f7d655a92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='53e415ce-bd4b-4a6f-bf8f-2f91700b528b',volume_size=None,volume_type=None)] {{(pid=116379) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 29 01:39:03.007693 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-a2de3988-a8c5-4a01-8f29-0b57d008ec6f tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.156177 Oct 29 01:39:03.008750 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 620/1250] 10.222.0.87 () {60 vars in 1146 bytes} [Fri Oct 29 01:39:01 2021] POST /compute/v2.1/servers => generated 406 bytes in 1158 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 01:39:03.019975 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-b20763ec-f729-4de1-98d0-c9756e451ecb tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:03.020733 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-b20763ec-f729-4de1-98d0-c9756e451ecb tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] [instance: a4afd50f-8af5-4a24-9636-525f7d655a92] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:39:03.243536 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-b20763ec-f729-4de1-98d0-c9756e451ecb tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef8571ef39b4efe8f510a28052e2b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84bceeeb4f67456a90779360ffc620aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:03.248953 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-b20763ec-f729-4de1-98d0-c9756e451ecb tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] 10.222.0.87 "GET /compute/v2.1/servers/a4afd50f-8af5-4a24-9636-525f7d655a92" status: 200 len: 1095 microversion: 2.1 time: 0.233614 Oct 29 01:39:03.249806 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 631/1251] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:39:03 2021] GET /compute/v2.1/servers/a4afd50f-8af5-4a24-9636-525f7d655a92 => generated 1095 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:39:04.270712 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-be422066-6b4f-4c80-b796-7cebb5cb3f84 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:04.271401 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-be422066-6b4f-4c80-b796-7cebb5cb3f84 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] [instance: a4afd50f-8af5-4a24-9636-525f7d655a92] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:39:04.279386 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-be422066-6b4f-4c80-b796-7cebb5cb3f84 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:39:04.279930 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-be422066-6b4f-4c80-b796-7cebb5cb3f84 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:39:04.280750 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-be422066-6b4f-4c80-b796-7cebb5cb3f84 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:39:04.281243 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-be422066-6b4f-4c80-b796-7cebb5cb3f84 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:39:04.403547 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-be422066-6b4f-4c80-b796-7cebb5cb3f84 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef8571ef39b4efe8f510a28052e2b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84bceeeb4f67456a90779360ffc620aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:04.411081 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-be422066-6b4f-4c80-b796-7cebb5cb3f84 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] 10.222.0.87 "GET /compute/v2.1/servers/a4afd50f-8af5-4a24-9636-525f7d655a92" status: 200 len: 1145 microversion: 2.1 time: 0.146317 Oct 29 01:39:04.411646 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 621/1252] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:39:04 2021] GET /compute/v2.1/servers/a4afd50f-8af5-4a24-9636-525f7d655a92 => generated 1145 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:39:05.428090 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-6b078ead-ca1f-473a-aaa6-2f6cb6d4afe9 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:05.428687 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-6b078ead-ca1f-473a-aaa6-2f6cb6d4afe9 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] [instance: a4afd50f-8af5-4a24-9636-525f7d655a92] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:39:05.435666 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-6b078ead-ca1f-473a-aaa6-2f6cb6d4afe9 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:39:05.436134 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-6b078ead-ca1f-473a-aaa6-2f6cb6d4afe9 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:39:05.436898 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-6b078ead-ca1f-473a-aaa6-2f6cb6d4afe9 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:39:05.437324 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-6b078ead-ca1f-473a-aaa6-2f6cb6d4afe9 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:39:05.500830 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-6b078ead-ca1f-473a-aaa6-2f6cb6d4afe9 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef8571ef39b4efe8f510a28052e2b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84bceeeb4f67456a90779360ffc620aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:05.508330 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-6b078ead-ca1f-473a-aaa6-2f6cb6d4afe9 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] 10.222.0.87 "GET /compute/v2.1/servers/a4afd50f-8af5-4a24-9636-525f7d655a92" status: 200 len: 1137 microversion: 2.1 time: 0.083862 Oct 29 01:39:05.509070 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 632/1253] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:39:05 2021] GET /compute/v2.1/servers/a4afd50f-8af5-4a24-9636-525f7d655a92 => generated 1137 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:39:05.627256 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 01:39:05.627595 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: Fri Oct 29 01:39:05 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 29 01:39:06.525896 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-45488173-ef5a-471f-af0b-3fa5b8f5264d tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:06.526484 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-45488173-ef5a-471f-af0b-3fa5b8f5264d tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] [instance: a4afd50f-8af5-4a24-9636-525f7d655a92] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:39:06.532958 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-45488173-ef5a-471f-af0b-3fa5b8f5264d tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:39:06.533659 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-45488173-ef5a-471f-af0b-3fa5b8f5264d tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:39:06.534168 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-45488173-ef5a-471f-af0b-3fa5b8f5264d tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:39:06.534594 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-45488173-ef5a-471f-af0b-3fa5b8f5264d tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:39:06.594986 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-45488173-ef5a-471f-af0b-3fa5b8f5264d tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef8571ef39b4efe8f510a28052e2b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84bceeeb4f67456a90779360ffc620aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:06.602496 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-45488173-ef5a-471f-af0b-3fa5b8f5264d tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] 10.222.0.87 "GET /compute/v2.1/servers/a4afd50f-8af5-4a24-9636-525f7d655a92" status: 200 len: 1137 microversion: 2.1 time: 0.080310 Oct 29 01:39:06.603059 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 622/1254] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:39:06 2021] GET /compute/v2.1/servers/a4afd50f-8af5-4a24-9636-525f7d655a92 => generated 1137 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:39:07.620516 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-df581d7a-8d30-46d8-ac8c-edb6b7d4cf21 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:07.621153 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-df581d7a-8d30-46d8-ac8c-edb6b7d4cf21 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] [instance: a4afd50f-8af5-4a24-9636-525f7d655a92] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:39:07.628062 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-df581d7a-8d30-46d8-ac8c-edb6b7d4cf21 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:39:07.628547 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-df581d7a-8d30-46d8-ac8c-edb6b7d4cf21 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:39:07.629356 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-df581d7a-8d30-46d8-ac8c-edb6b7d4cf21 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:39:07.629894 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-df581d7a-8d30-46d8-ac8c-edb6b7d4cf21 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:39:07.693415 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-df581d7a-8d30-46d8-ac8c-edb6b7d4cf21 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef8571ef39b4efe8f510a28052e2b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84bceeeb4f67456a90779360ffc620aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:07.704687 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-df581d7a-8d30-46d8-ac8c-edb6b7d4cf21 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] 10.222.0.87 "GET /compute/v2.1/servers/a4afd50f-8af5-4a24-9636-525f7d655a92" status: 200 len: 1193 microversion: 2.1 time: 0.087822 Oct 29 01:39:07.706640 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 633/1255] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:39:07 2021] GET /compute/v2.1/servers/a4afd50f-8af5-4a24-9636-525f7d655a92 => generated 1193 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:39:08.724133 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-81019fb6-d785-484b-8887-6581c2d01323 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:08.724755 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-81019fb6-d785-484b-8887-6581c2d01323 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] [instance: a4afd50f-8af5-4a24-9636-525f7d655a92] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:39:08.731415 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-81019fb6-d785-484b-8887-6581c2d01323 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:39:08.731924 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-81019fb6-d785-484b-8887-6581c2d01323 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:39:08.732727 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-81019fb6-d785-484b-8887-6581c2d01323 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:39:08.733168 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-81019fb6-d785-484b-8887-6581c2d01323 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:39:08.821788 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-81019fb6-d785-484b-8887-6581c2d01323 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef8571ef39b4efe8f510a28052e2b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84bceeeb4f67456a90779360ffc620aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:08.829536 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-81019fb6-d785-484b-8887-6581c2d01323 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] 10.222.0.87 "GET /compute/v2.1/servers/a4afd50f-8af5-4a24-9636-525f7d655a92" status: 200 len: 1211 microversion: 2.1 time: 0.109829 Oct 29 01:39:08.830905 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 623/1256] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:39:08 2021] GET /compute/v2.1/servers/a4afd50f-8af5-4a24-9636-525f7d655a92 => generated 1211 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:39:09.848008 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-ff1edda4-b974-4ba7-bace-7daa2e7e04f8 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:09.849013 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-ff1edda4-b974-4ba7-bace-7daa2e7e04f8 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] [instance: a4afd50f-8af5-4a24-9636-525f7d655a92] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:39:09.881117 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ff1edda4-b974-4ba7-bace-7daa2e7e04f8 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:39:09.881117 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ff1edda4-b974-4ba7-bace-7daa2e7e04f8 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:39:09.883156 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ff1edda4-b974-4ba7-bace-7daa2e7e04f8 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:39:09.884338 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ff1edda4-b974-4ba7-bace-7daa2e7e04f8 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:39:10.113786 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-ff1edda4-b974-4ba7-bace-7daa2e7e04f8 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef8571ef39b4efe8f510a28052e2b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84bceeeb4f67456a90779360ffc620aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:10.121717 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-ff1edda4-b974-4ba7-bace-7daa2e7e04f8 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] 10.222.0.87 "GET /compute/v2.1/servers/a4afd50f-8af5-4a24-9636-525f7d655a92" status: 200 len: 1279 microversion: 2.1 time: 0.277799 Oct 29 01:39:10.122290 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 634/1257] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:39:09 2021] GET /compute/v2.1/servers/a4afd50f-8af5-4a24-9636-525f7d655a92 => generated 1279 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:39:10.304166 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [req-88abae1c-8341-431f-808e-f724243df062 req-f163a1e1-bdc9-4465-bdb1-8003e9b43de7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4afd50f-8af5-4a24-9636-525f7d655a92", "tag": "8a8ce161-bc5b-4343-8c2d-f23cbcc94787"}]} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:39:10.308043 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:39:10.308043 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: warnings.warn(msg) Oct 29 01:39:10.322198 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [req-88abae1c-8341-431f-808e-f724243df062 req-f163a1e1-bdc9-4465-bdb1-8003e9b43de7 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:39:10.322198 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [req-88abae1c-8341-431f-808e-f724243df062 req-f163a1e1-bdc9-4465-bdb1-8003e9b43de7 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:39:10.338396 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.compute.server_external_events [req-88abae1c-8341-431f-808e-f724243df062 req-f163a1e1-bdc9-4465-bdb1-8003e9b43de7 service nova] Creating event network-changed:8a8ce161-bc5b-4343-8c2d-f23cbcc94787 for instance a4afd50f-8af5-4a24-9636-525f7d655a92 on hv-cinder-81398 Oct 29 01:39:10.343892 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [req-88abae1c-8341-431f-808e-f724243df062 req-f163a1e1-bdc9-4465-bdb1-8003e9b43de7 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047257 Oct 29 01:39:10.344557 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 624/1258] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Oct 29 01:39:10 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:39:11.141513 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-fb09bcbc-ffe5-4713-a387-6440a3baa72b tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:11.142348 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-fb09bcbc-ffe5-4713-a387-6440a3baa72b tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] [instance: a4afd50f-8af5-4a24-9636-525f7d655a92] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:39:11.149710 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-fb09bcbc-ffe5-4713-a387-6440a3baa72b tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:39:11.150356 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-fb09bcbc-ffe5-4713-a387-6440a3baa72b tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:39:11.150930 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-fb09bcbc-ffe5-4713-a387-6440a3baa72b tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:39:11.151363 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-fb09bcbc-ffe5-4713-a387-6440a3baa72b tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:39:11.395544 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-fb09bcbc-ffe5-4713-a387-6440a3baa72b tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef8571ef39b4efe8f510a28052e2b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84bceeeb4f67456a90779360ffc620aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:11.403163 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-fb09bcbc-ffe5-4713-a387-6440a3baa72b tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] 10.222.0.87 "GET /compute/v2.1/servers/a4afd50f-8af5-4a24-9636-525f7d655a92" status: 200 len: 1267 microversion: 2.1 time: 0.266068 Oct 29 01:39:11.403755 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 635/1259] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:39:11 2021] GET /compute/v2.1/servers/a4afd50f-8af5-4a24-9636-525f7d655a92 => generated 1267 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:39:12.422333 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-b90eb6da-09e2-4c90-8df5-a5b55cdc3305 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:12.423057 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-b90eb6da-09e2-4c90-8df5-a5b55cdc3305 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] [instance: a4afd50f-8af5-4a24-9636-525f7d655a92] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:39:12.430259 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-b90eb6da-09e2-4c90-8df5-a5b55cdc3305 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:39:12.430700 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-b90eb6da-09e2-4c90-8df5-a5b55cdc3305 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:39:12.431470 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-b90eb6da-09e2-4c90-8df5-a5b55cdc3305 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:39:12.431928 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-b90eb6da-09e2-4c90-8df5-a5b55cdc3305 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:39:12.559710 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-b90eb6da-09e2-4c90-8df5-a5b55cdc3305 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef8571ef39b4efe8f510a28052e2b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84bceeeb4f67456a90779360ffc620aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:12.568261 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-b90eb6da-09e2-4c90-8df5-a5b55cdc3305 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] 10.222.0.87 "GET /compute/v2.1/servers/a4afd50f-8af5-4a24-9636-525f7d655a92" status: 200 len: 1267 microversion: 2.1 time: 0.150618 Oct 29 01:39:12.568808 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 625/1260] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:39:12 2021] GET /compute/v2.1/servers/a4afd50f-8af5-4a24-9636-525f7d655a92 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:39:13.585753 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-4522c562-95bb-4a02-b430-6b2ebd515b7c tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:13.586371 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-4522c562-95bb-4a02-b430-6b2ebd515b7c tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] [instance: a4afd50f-8af5-4a24-9636-525f7d655a92] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:39:13.592565 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4522c562-95bb-4a02-b430-6b2ebd515b7c tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:39:13.592985 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4522c562-95bb-4a02-b430-6b2ebd515b7c tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:39:13.593740 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4522c562-95bb-4a02-b430-6b2ebd515b7c tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:39:13.594163 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-4522c562-95bb-4a02-b430-6b2ebd515b7c tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:39:13.744554 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-4522c562-95bb-4a02-b430-6b2ebd515b7c tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef8571ef39b4efe8f510a28052e2b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84bceeeb4f67456a90779360ffc620aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:13.752339 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-4522c562-95bb-4a02-b430-6b2ebd515b7c tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] 10.222.0.87 "GET /compute/v2.1/servers/a4afd50f-8af5-4a24-9636-525f7d655a92" status: 200 len: 1267 microversion: 2.1 time: 0.170314 Oct 29 01:39:13.752907 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 636/1261] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:39:13 2021] GET /compute/v2.1/servers/a4afd50f-8af5-4a24-9636-525f7d655a92 => generated 1267 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:39:13.892115 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 01:39:13.894997 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: Fri Oct 29 01:39:13 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 29 01:39:14.772150 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-d1a604b2-eac1-4b83-8839-40c8a204cb97 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:14.772919 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-d1a604b2-eac1-4b83-8839-40c8a204cb97 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] [instance: a4afd50f-8af5-4a24-9636-525f7d655a92] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:39:14.779200 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d1a604b2-eac1-4b83-8839-40c8a204cb97 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:39:14.779766 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d1a604b2-eac1-4b83-8839-40c8a204cb97 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:39:14.780608 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d1a604b2-eac1-4b83-8839-40c8a204cb97 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:39:14.781067 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d1a604b2-eac1-4b83-8839-40c8a204cb97 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:39:14.911914 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-d1a604b2-eac1-4b83-8839-40c8a204cb97 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef8571ef39b4efe8f510a28052e2b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84bceeeb4f67456a90779360ffc620aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:14.919270 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-d1a604b2-eac1-4b83-8839-40c8a204cb97 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] 10.222.0.87 "GET /compute/v2.1/servers/a4afd50f-8af5-4a24-9636-525f7d655a92" status: 200 len: 1267 microversion: 2.1 time: 0.152300 Oct 29 01:39:14.920145 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 626/1262] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:39:14 2021] GET /compute/v2.1/servers/a4afd50f-8af5-4a24-9636-525f7d655a92 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:39:15.936336 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-d5ebe37a-3621-430d-bf99-9a960031c6bc tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:15.936942 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-d5ebe37a-3621-430d-bf99-9a960031c6bc tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] [instance: a4afd50f-8af5-4a24-9636-525f7d655a92] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:39:15.944335 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-d5ebe37a-3621-430d-bf99-9a960031c6bc tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:39:15.944781 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-d5ebe37a-3621-430d-bf99-9a960031c6bc tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:39:15.945558 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-d5ebe37a-3621-430d-bf99-9a960031c6bc tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:39:15.945989 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-d5ebe37a-3621-430d-bf99-9a960031c6bc tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:39:16.085432 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-d5ebe37a-3621-430d-bf99-9a960031c6bc tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef8571ef39b4efe8f510a28052e2b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84bceeeb4f67456a90779360ffc620aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:16.092973 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-d5ebe37a-3621-430d-bf99-9a960031c6bc tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] 10.222.0.87 "GET /compute/v2.1/servers/a4afd50f-8af5-4a24-9636-525f7d655a92" status: 200 len: 1267 microversion: 2.1 time: 0.160211 Oct 29 01:39:16.095845 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 637/1263] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:39:15 2021] GET /compute/v2.1/servers/a4afd50f-8af5-4a24-9636-525f7d655a92 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:39:17.109611 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-5b97f62c-46ec-4402-bde9-c34b789e5a1c tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:17.110162 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-5b97f62c-46ec-4402-bde9-c34b789e5a1c tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] [instance: a4afd50f-8af5-4a24-9636-525f7d655a92] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:39:17.116383 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-5b97f62c-46ec-4402-bde9-c34b789e5a1c tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:39:17.116825 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-5b97f62c-46ec-4402-bde9-c34b789e5a1c tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:39:17.117594 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-5b97f62c-46ec-4402-bde9-c34b789e5a1c tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:39:17.118051 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-5b97f62c-46ec-4402-bde9-c34b789e5a1c tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:39:17.251189 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-5b97f62c-46ec-4402-bde9-c34b789e5a1c tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef8571ef39b4efe8f510a28052e2b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84bceeeb4f67456a90779360ffc620aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:17.258767 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-5b97f62c-46ec-4402-bde9-c34b789e5a1c tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] 10.222.0.87 "GET /compute/v2.1/servers/a4afd50f-8af5-4a24-9636-525f7d655a92" status: 200 len: 1267 microversion: 2.1 time: 0.152952 Oct 29 01:39:17.259336 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 627/1264] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:39:17 2021] GET /compute/v2.1/servers/a4afd50f-8af5-4a24-9636-525f7d655a92 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:39:18.276302 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-334378bb-6f05-48f4-a3c4-f95e0df0f60b tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:18.276871 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-334378bb-6f05-48f4-a3c4-f95e0df0f60b tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] [instance: a4afd50f-8af5-4a24-9636-525f7d655a92] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:39:18.284321 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-334378bb-6f05-48f4-a3c4-f95e0df0f60b tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:39:18.284759 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-334378bb-6f05-48f4-a3c4-f95e0df0f60b tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:39:18.285610 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-334378bb-6f05-48f4-a3c4-f95e0df0f60b tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:39:18.286037 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-334378bb-6f05-48f4-a3c4-f95e0df0f60b tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:39:18.424013 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-334378bb-6f05-48f4-a3c4-f95e0df0f60b tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef8571ef39b4efe8f510a28052e2b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84bceeeb4f67456a90779360ffc620aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:18.424013 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-334378bb-6f05-48f4-a3c4-f95e0df0f60b tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] 10.222.0.87 "GET /compute/v2.1/servers/a4afd50f-8af5-4a24-9636-525f7d655a92" status: 200 len: 1267 microversion: 2.1 time: 0.144139 Oct 29 01:39:18.424013 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 638/1265] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:39:18 2021] GET /compute/v2.1/servers/a4afd50f-8af5-4a24-9636-525f7d655a92 => generated 1267 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:39:19.434712 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-74ea6bb5-202e-4311-bcd5-16caf51f1b21 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:19.435331 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-74ea6bb5-202e-4311-bcd5-16caf51f1b21 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] [instance: a4afd50f-8af5-4a24-9636-525f7d655a92] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:39:19.442666 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-74ea6bb5-202e-4311-bcd5-16caf51f1b21 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:39:19.443487 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-74ea6bb5-202e-4311-bcd5-16caf51f1b21 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:39:19.444552 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-74ea6bb5-202e-4311-bcd5-16caf51f1b21 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:39:19.445233 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-74ea6bb5-202e-4311-bcd5-16caf51f1b21 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:39:19.578956 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-74ea6bb5-202e-4311-bcd5-16caf51f1b21 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef8571ef39b4efe8f510a28052e2b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84bceeeb4f67456a90779360ffc620aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:19.587845 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-74ea6bb5-202e-4311-bcd5-16caf51f1b21 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] 10.222.0.87 "GET /compute/v2.1/servers/a4afd50f-8af5-4a24-9636-525f7d655a92" status: 200 len: 1267 microversion: 2.1 time: 0.157230 Oct 29 01:39:19.588647 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 628/1266] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:39:19 2021] GET /compute/v2.1/servers/a4afd50f-8af5-4a24-9636-525f7d655a92 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:39:20.604970 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-702b9e69-e718-40e9-beb1-704303cd5f9b tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:20.605622 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-702b9e69-e718-40e9-beb1-704303cd5f9b tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] [instance: a4afd50f-8af5-4a24-9636-525f7d655a92] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:39:20.613823 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-702b9e69-e718-40e9-beb1-704303cd5f9b tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:39:20.614480 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-702b9e69-e718-40e9-beb1-704303cd5f9b tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:39:20.615250 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-702b9e69-e718-40e9-beb1-704303cd5f9b tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:39:20.615676 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-702b9e69-e718-40e9-beb1-704303cd5f9b tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:39:20.762079 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-702b9e69-e718-40e9-beb1-704303cd5f9b tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef8571ef39b4efe8f510a28052e2b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84bceeeb4f67456a90779360ffc620aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:20.770968 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-702b9e69-e718-40e9-beb1-704303cd5f9b tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] 10.222.0.87 "GET /compute/v2.1/servers/a4afd50f-8af5-4a24-9636-525f7d655a92" status: 200 len: 1267 microversion: 2.1 time: 0.169696 Oct 29 01:39:20.771542 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 639/1267] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:39:20 2021] GET /compute/v2.1/servers/a4afd50f-8af5-4a24-9636-525f7d655a92 => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:39:21.616198 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [req-00ae51ce-20b2-4986-ae2c-7170428b309c req-c15d33d4-e015-4d62-aa3f-97fc196cfee2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4afd50f-8af5-4a24-9636-525f7d655a92", "name": "network-vif-plugged", "status": "completed", "tag": "8a8ce161-bc5b-4343-8c2d-f23cbcc94787"}]} {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:39:21.626283 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:39:21.626283 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: warnings.warn(msg) Oct 29 01:39:21.631646 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [req-00ae51ce-20b2-4986-ae2c-7170428b309c req-c15d33d4-e015-4d62-aa3f-97fc196cfee2 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:39:21.632336 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [req-00ae51ce-20b2-4986-ae2c-7170428b309c req-c15d33d4-e015-4d62-aa3f-97fc196cfee2 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:39:21.653057 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.compute.server_external_events [req-00ae51ce-20b2-4986-ae2c-7170428b309c req-c15d33d4-e015-4d62-aa3f-97fc196cfee2 service nova] Creating event network-vif-plugged:8a8ce161-bc5b-4343-8c2d-f23cbcc94787 for instance a4afd50f-8af5-4a24-9636-525f7d655a92 on hv-cinder-81398 Oct 29 01:39:21.661401 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [req-00ae51ce-20b2-4986-ae2c-7170428b309c req-c15d33d4-e015-4d62-aa3f-97fc196cfee2 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052319 Oct 29 01:39:21.662302 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 629/1268] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Oct 29 01:39:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:39:21.788789 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-ac722d77-a954-4355-b99c-f3f382d09c2d tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:21.789385 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-ac722d77-a954-4355-b99c-f3f382d09c2d tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] [instance: a4afd50f-8af5-4a24-9636-525f7d655a92] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:39:21.795784 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ac722d77-a954-4355-b99c-f3f382d09c2d tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:39:21.796232 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ac722d77-a954-4355-b99c-f3f382d09c2d tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:39:21.797012 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ac722d77-a954-4355-b99c-f3f382d09c2d tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:39:21.797450 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-ac722d77-a954-4355-b99c-f3f382d09c2d tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:39:21.933360 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-ac722d77-a954-4355-b99c-f3f382d09c2d tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef8571ef39b4efe8f510a28052e2b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84bceeeb4f67456a90779360ffc620aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:21.941469 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-ac722d77-a954-4355-b99c-f3f382d09c2d tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] 10.222.0.87 "GET /compute/v2.1/servers/a4afd50f-8af5-4a24-9636-525f7d655a92" status: 200 len: 1267 microversion: 2.1 time: 0.156447 Oct 29 01:39:21.942034 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 640/1269] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:39:21 2021] GET /compute/v2.1/servers/a4afd50f-8af5-4a24-9636-525f7d655a92 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:39:22.960335 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-7e40eb92-1c4f-4981-806d-cd07ab911028 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:22.961014 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-7e40eb92-1c4f-4981-806d-cd07ab911028 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] [instance: a4afd50f-8af5-4a24-9636-525f7d655a92] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:39:22.967231 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-7e40eb92-1c4f-4981-806d-cd07ab911028 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:39:22.967672 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-7e40eb92-1c4f-4981-806d-cd07ab911028 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:39:22.968449 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-7e40eb92-1c4f-4981-806d-cd07ab911028 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:39:22.968876 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-7e40eb92-1c4f-4981-806d-cd07ab911028 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:39:23.092312 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-7e40eb92-1c4f-4981-806d-cd07ab911028 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef8571ef39b4efe8f510a28052e2b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84bceeeb4f67456a90779360ffc620aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:23.100655 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-7e40eb92-1c4f-4981-806d-cd07ab911028 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] 10.222.0.87 "GET /compute/v2.1/servers/a4afd50f-8af5-4a24-9636-525f7d655a92" status: 200 len: 1267 microversion: 2.1 time: 0.144977 Oct 29 01:39:23.103164 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 630/1270] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:39:22 2021] GET /compute/v2.1/servers/a4afd50f-8af5-4a24-9636-525f7d655a92 => generated 1267 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:39:24.117794 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-1d1d99a6-1856-4c85-87ad-c12fa4bb7c52 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:24.118476 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-1d1d99a6-1856-4c85-87ad-c12fa4bb7c52 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] [instance: a4afd50f-8af5-4a24-9636-525f7d655a92] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:39:24.124811 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-1d1d99a6-1856-4c85-87ad-c12fa4bb7c52 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:39:24.125171 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-1d1d99a6-1856-4c85-87ad-c12fa4bb7c52 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:39:24.125963 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-1d1d99a6-1856-4c85-87ad-c12fa4bb7c52 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:39:24.127233 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-1d1d99a6-1856-4c85-87ad-c12fa4bb7c52 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:39:24.252409 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-1d1d99a6-1856-4c85-87ad-c12fa4bb7c52 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef8571ef39b4efe8f510a28052e2b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84bceeeb4f67456a90779360ffc620aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:24.259901 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-1d1d99a6-1856-4c85-87ad-c12fa4bb7c52 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] 10.222.0.87 "GET /compute/v2.1/servers/a4afd50f-8af5-4a24-9636-525f7d655a92" status: 200 len: 1453 microversion: 2.1 time: 0.145993 Oct 29 01:39:24.260501 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 641/1271] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:39:24 2021] GET /compute/v2.1/servers/a4afd50f-8af5-4a24-9636-525f7d655a92 => generated 1453 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:39:24.276579 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-6019f0f6-8a08-491b-88fa-28071a39defd tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:39:24.277166 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-6019f0f6-8a08-491b-88fa-28071a39defd tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] [instance: a4afd50f-8af5-4a24-9636-525f7d655a92] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:39:24.284256 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-6019f0f6-8a08-491b-88fa-28071a39defd tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:39:24.284698 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-6019f0f6-8a08-491b-88fa-28071a39defd tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:39:24.285463 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-6019f0f6-8a08-491b-88fa-28071a39defd tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:39:24.285889 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-6019f0f6-8a08-491b-88fa-28071a39defd tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:39:24.408693 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-6019f0f6-8a08-491b-88fa-28071a39defd tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef8571ef39b4efe8f510a28052e2b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84bceeeb4f67456a90779360ffc620aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:39:24.416084 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-6019f0f6-8a08-491b-88fa-28071a39defd tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] 10.222.0.87 "GET /compute/v2.1/servers/a4afd50f-8af5-4a24-9636-525f7d655a92" status: 200 len: 1453 microversion: 2.1 time: 0.143586 Oct 29 01:39:24.416794 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 631/1272] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:39:24 2021] GET /compute/v2.1/servers/a4afd50f-8af5-4a24-9636-525f7d655a92 => generated 1453 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:39:26.612708 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [req-a7571c05-9e67-406e-aa4c-014f8ca398ca req-3823d1b0-6cc5-4b3e-8358-2d5abf0cda3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4afd50f-8af5-4a24-9636-525f7d655a92", "tag": "8a8ce161-bc5b-4343-8c2d-f23cbcc94787"}]} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:39:26.614323 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:39:26.614323 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: warnings.warn(msg) Oct 29 01:39:26.621298 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [req-a7571c05-9e67-406e-aa4c-014f8ca398ca req-3823d1b0-6cc5-4b3e-8358-2d5abf0cda3b service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:39:26.621806 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [req-a7571c05-9e67-406e-aa4c-014f8ca398ca req-3823d1b0-6cc5-4b3e-8358-2d5abf0cda3b service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:39:26.635229 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.compute.server_external_events [req-a7571c05-9e67-406e-aa4c-014f8ca398ca req-3823d1b0-6cc5-4b3e-8358-2d5abf0cda3b service nova] Creating event network-changed:8a8ce161-bc5b-4343-8c2d-f23cbcc94787 for instance a4afd50f-8af5-4a24-9636-525f7d655a92 on hv-cinder-81398 Oct 29 01:39:26.640405 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [req-a7571c05-9e67-406e-aa4c-014f8ca398ca req-3823d1b0-6cc5-4b3e-8358-2d5abf0cda3b service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.167124 Oct 29 01:39:26.641012 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 642/1273] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Oct 29 01:39:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:40:54.440981 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 01:40:54.441719 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: Fri Oct 29 01:40:54 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 29 01:40:55.043215 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-25f4b63b-a437-4364-807b-5fe2b7db699d tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:55.043779 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-25f4b63b-a437-4364-807b-5fe2b7db699d tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] [instance: a4afd50f-8af5-4a24-9636-525f7d655a92] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:40:55.046790 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [req-56c96b59-ae4a-4f0a-b4eb-42be92a07837 req-d6ce122b-1186-48a8-905d-8443b9dad49a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4afd50f-8af5-4a24-9636-525f7d655a92", "tag": "8a8ce161-bc5b-4343-8c2d-f23cbcc94787"}]} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:40:55.048633 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:40:55.048633 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: warnings.warn(msg) Oct 29 01:40:55.050455 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-25f4b63b-a437-4364-807b-5fe2b7db699d tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:40:55.051139 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-25f4b63b-a437-4364-807b-5fe2b7db699d tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:40:55.052461 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-25f4b63b-a437-4364-807b-5fe2b7db699d tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:40:55.053114 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-25f4b63b-a437-4364-807b-5fe2b7db699d tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:40:55.055582 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [req-56c96b59-ae4a-4f0a-b4eb-42be92a07837 req-d6ce122b-1186-48a8-905d-8443b9dad49a service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:40:55.056031 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [req-56c96b59-ae4a-4f0a-b4eb-42be92a07837 req-d6ce122b-1186-48a8-905d-8443b9dad49a service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:40:55.067639 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.compute.server_external_events [req-56c96b59-ae4a-4f0a-b4eb-42be92a07837 req-d6ce122b-1186-48a8-905d-8443b9dad49a service nova] Creating event network-changed:8a8ce161-bc5b-4343-8c2d-f23cbcc94787 for instance a4afd50f-8af5-4a24-9636-525f7d655a92 on hv-cinder-81398 Oct 29 01:40:55.073105 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [req-56c96b59-ae4a-4f0a-b4eb-42be92a07837 req-d6ce122b-1186-48a8-905d-8443b9dad49a service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031980 Oct 29 01:40:55.074016 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 643/1274] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Oct 29 01:40:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:40:55.086065 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-25f4b63b-a437-4364-807b-5fe2b7db699d tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] [instance: a4afd50f-8af5-4a24-9636-525f7d655a92] Going to try to terminate instance {{(pid=116379) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 29 01:40:55.385152 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-25f4b63b-a437-4364-807b-5fe2b7db699d tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] 10.222.0.87 "DELETE /compute/v2.1/servers/a4afd50f-8af5-4a24-9636-525f7d655a92" status: 204 len: 0 microversion: 2.1 time: 0.346905 Oct 29 01:40:55.397021 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 632/1275] 10.222.0.87 () {58 vars in 1238 bytes} [Fri Oct 29 01:40:55 2021] DELETE /compute/v2.1/servers/a4afd50f-8af5-4a24-9636-525f7d655a92 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 01:40:55.397179 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-c4c9d35f-13a1-435c-91ae-faa251400a43 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:55.397179 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-c4c9d35f-13a1-435c-91ae-faa251400a43 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] [instance: a4afd50f-8af5-4a24-9636-525f7d655a92] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:40:55.402742 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c4c9d35f-13a1-435c-91ae-faa251400a43 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:40:55.403125 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c4c9d35f-13a1-435c-91ae-faa251400a43 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:40:55.403920 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c4c9d35f-13a1-435c-91ae-faa251400a43 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:40:55.404347 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c4c9d35f-13a1-435c-91ae-faa251400a43 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:40:55.631557 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-c4c9d35f-13a1-435c-91ae-faa251400a43 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef8571ef39b4efe8f510a28052e2b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84bceeeb4f67456a90779360ffc620aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:55.640501 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-c4c9d35f-13a1-435c-91ae-faa251400a43 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] 10.222.0.87 "GET /compute/v2.1/servers/a4afd50f-8af5-4a24-9636-525f7d655a92" status: 200 len: 1578 microversion: 2.1 time: 0.248628 Oct 29 01:40:55.641075 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 644/1276] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:40:55 2021] GET /compute/v2.1/servers/a4afd50f-8af5-4a24-9636-525f7d655a92 => generated 1578 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:40:56.658633 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-7cb6a127-3468-42e2-988a-8aea3517f00e tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:56.659274 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-7cb6a127-3468-42e2-988a-8aea3517f00e tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] [instance: a4afd50f-8af5-4a24-9636-525f7d655a92] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:40:56.666352 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-7cb6a127-3468-42e2-988a-8aea3517f00e tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:40:56.666793 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-7cb6a127-3468-42e2-988a-8aea3517f00e tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:40:56.667564 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-7cb6a127-3468-42e2-988a-8aea3517f00e tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:40:56.668366 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-7cb6a127-3468-42e2-988a-8aea3517f00e tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:40:56.793757 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-7cb6a127-3468-42e2-988a-8aea3517f00e tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef8571ef39b4efe8f510a28052e2b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84bceeeb4f67456a90779360ffc620aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:56.801329 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-7cb6a127-3468-42e2-988a-8aea3517f00e tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] 10.222.0.87 "GET /compute/v2.1/servers/a4afd50f-8af5-4a24-9636-525f7d655a92" status: 200 len: 1459 microversion: 2.1 time: 0.146927 Oct 29 01:40:56.801907 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 633/1277] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:40:56 2021] GET /compute/v2.1/servers/a4afd50f-8af5-4a24-9636-525f7d655a92 => generated 1459 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:40:57.621821 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [req-c3800a87-2cd2-4a46-b118-01d9ac11c00e req-31a63fc2-0e33-4e5a-9c0d-5ab7747fe227 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4afd50f-8af5-4a24-9636-525f7d655a92", "name": "network-vif-deleted", "tag": "8a8ce161-bc5b-4343-8c2d-f23cbcc94787"}]} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:40:57.624154 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:40:57.624154 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: warnings.warn(msg) Oct 29 01:40:57.631984 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [req-c3800a87-2cd2-4a46-b118-01d9ac11c00e req-31a63fc2-0e33-4e5a-9c0d-5ab7747fe227 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:40:57.632423 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [req-c3800a87-2cd2-4a46-b118-01d9ac11c00e req-31a63fc2-0e33-4e5a-9c0d-5ab7747fe227 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:40:57.649572 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.compute.server_external_events [req-c3800a87-2cd2-4a46-b118-01d9ac11c00e req-31a63fc2-0e33-4e5a-9c0d-5ab7747fe227 service nova] Creating event network-vif-deleted:8a8ce161-bc5b-4343-8c2d-f23cbcc94787 for instance a4afd50f-8af5-4a24-9636-525f7d655a92 on hv-cinder-81398 Oct 29 01:40:57.658269 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [req-c3800a87-2cd2-4a46-b118-01d9ac11c00e req-31a63fc2-0e33-4e5a-9c0d-5ab7747fe227 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036503 Oct 29 01:40:57.659498 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 645/1278] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Oct 29 01:40:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:40:57.818235 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-d68e0871-dd7f-4715-bc24-3346b69ca72d tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:57.818847 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-d68e0871-dd7f-4715-bc24-3346b69ca72d tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] [instance: a4afd50f-8af5-4a24-9636-525f7d655a92] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:40:57.825072 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d68e0871-dd7f-4715-bc24-3346b69ca72d tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:40:57.825525 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d68e0871-dd7f-4715-bc24-3346b69ca72d tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:40:57.826304 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d68e0871-dd7f-4715-bc24-3346b69ca72d tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:40:57.826862 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-d68e0871-dd7f-4715-bc24-3346b69ca72d tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:40:57.888749 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-d68e0871-dd7f-4715-bc24-3346b69ca72d tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef8571ef39b4efe8f510a28052e2b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84bceeeb4f67456a90779360ffc620aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:40:57.896516 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-d68e0871-dd7f-4715-bc24-3346b69ca72d tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] 10.222.0.87 "GET /compute/v2.1/servers/a4afd50f-8af5-4a24-9636-525f7d655a92" status: 200 len: 1226 microversion: 2.1 time: 0.081875 Oct 29 01:40:57.897101 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 634/1279] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:40:57 2021] GET /compute/v2.1/servers/a4afd50f-8af5-4a24-9636-525f7d655a92 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:40:58.915758 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-6dd282bf-6609-46cd-ada6-2f4db4672623 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:40:58.916442 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-6dd282bf-6609-46cd-ada6-2f4db4672623 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] [instance: a4afd50f-8af5-4a24-9636-525f7d655a92] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:40:58.923457 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-6dd282bf-6609-46cd-ada6-2f4db4672623 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:40:58.923933 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-6dd282bf-6609-46cd-ada6-2f4db4672623 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:40:58.926469 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-6dd282bf-6609-46cd-ada6-2f4db4672623 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:40:58.926469 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-6dd282bf-6609-46cd-ada6-2f4db4672623 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:40:58.938240 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.wsgi [None req-6dd282bf-6609-46cd-ada6-2f4db4672623 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] HTTP exception thrown: Instance a4afd50f-8af5-4a24-9636-525f7d655a92 could not be found. Oct 29 01:40:58.938820 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-6dd282bf-6609-46cd-ada6-2f4db4672623 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Returning 404 to user: Instance a4afd50f-8af5-4a24-9636-525f7d655a92 could not be found. {{(pid=116378) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:40:58.939666 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-6dd282bf-6609-46cd-ada6-2f4db4672623 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] 10.222.0.87 "GET /compute/v2.1/servers/a4afd50f-8af5-4a24-9636-525f7d655a92" status: 404 len: 111 microversion: 2.1 time: 0.028421 Oct 29 01:40:58.940225 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 646/1280] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:40:58 2021] GET /compute/v2.1/servers/a4afd50f-8af5-4a24-9636-525f7d655a92 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:41:02.379338 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-cec8d1ad-ce0d-4a4d-9e9a-a7ceeaa1d9bc tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:41:02.380499 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-cec8d1ad-ce0d-4a4d-9e9a-a7ceeaa1d9bc tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] [instance: 529a34b2-5f55-4469-bace-404db6318de3] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:41:02.387169 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-cec8d1ad-ce0d-4a4d-9e9a-a7ceeaa1d9bc tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:41:02.387715 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-cec8d1ad-ce0d-4a4d-9e9a-a7ceeaa1d9bc tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:41:02.388587 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-cec8d1ad-ce0d-4a4d-9e9a-a7ceeaa1d9bc tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:41:02.389138 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-cec8d1ad-ce0d-4a4d-9e9a-a7ceeaa1d9bc tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:41:02.415000 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-cec8d1ad-ce0d-4a4d-9e9a-a7ceeaa1d9bc tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] [instance: 529a34b2-5f55-4469-bace-404db6318de3] Going to try to terminate instance {{(pid=116379) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 29 01:41:02.443246 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [req-23c6ed6d-9e65-4cdb-b279-44fdff4a66da req-8068ef59-2cce-44a1-9a27-c5becf153567 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "529a34b2-5f55-4469-bace-404db6318de3", "tag": "704607c3-0bdb-4458-b12a-5f98dc711d46"}]} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:41:02.445013 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:41:02.445013 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: warnings.warn(msg) Oct 29 01:41:02.452631 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [req-23c6ed6d-9e65-4cdb-b279-44fdff4a66da req-8068ef59-2cce-44a1-9a27-c5becf153567 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:41:02.453207 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [req-23c6ed6d-9e65-4cdb-b279-44fdff4a66da req-8068ef59-2cce-44a1-9a27-c5becf153567 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:41:02.464880 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.compute.server_external_events [req-23c6ed6d-9e65-4cdb-b279-44fdff4a66da req-8068ef59-2cce-44a1-9a27-c5becf153567 service nova] Creating event network-changed:704607c3-0bdb-4458-b12a-5f98dc711d46 for instance 529a34b2-5f55-4469-bace-404db6318de3 on hv-cinder-81398 Oct 29 01:41:02.473569 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [req-23c6ed6d-9e65-4cdb-b279-44fdff4a66da req-8068ef59-2cce-44a1-9a27-c5becf153567 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092593 Oct 29 01:41:02.473569 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 647/1281] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Oct 29 01:41:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 01:41:02.745428 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-cec8d1ad-ce0d-4a4d-9e9a-a7ceeaa1d9bc tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] 10.222.0.87 "DELETE /compute/v2.1/servers/529a34b2-5f55-4469-bace-404db6318de3" status: 204 len: 0 microversion: 2.1 time: 0.369464 Oct 29 01:41:02.746179 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 635/1282] 10.222.0.87 () {58 vars in 1238 bytes} [Fri Oct 29 01:41:02 2021] DELETE /compute/v2.1/servers/529a34b2-5f55-4469-bace-404db6318de3 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 01:41:02.757916 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-c1fca739-402c-4d4d-b2d1-956ae039fc0d tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:41:02.757916 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-c1fca739-402c-4d4d-b2d1-956ae039fc0d tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] [instance: 529a34b2-5f55-4469-bace-404db6318de3] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:41:02.761998 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c1fca739-402c-4d4d-b2d1-956ae039fc0d tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:41:02.762503 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c1fca739-402c-4d4d-b2d1-956ae039fc0d tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:41:02.763297 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c1fca739-402c-4d4d-b2d1-956ae039fc0d tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:41:02.764336 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-c1fca739-402c-4d4d-b2d1-956ae039fc0d tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:41:02.972022 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.policy [None req-c1fca739-402c-4d4d-b2d1-956ae039fc0d tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef8571ef39b4efe8f510a28052e2b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84bceeeb4f67456a90779360ffc620aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116378) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:41:02.986450 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-c1fca739-402c-4d4d-b2d1-956ae039fc0d tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] 10.222.0.87 "GET /compute/v2.1/servers/529a34b2-5f55-4469-bace-404db6318de3" status: 200 len: 1578 microversion: 2.1 time: 0.235474 Oct 29 01:41:02.990351 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 648/1283] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:41:02 2021] GET /compute/v2.1/servers/529a34b2-5f55-4469-bace-404db6318de3 => generated 1578 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:41:04.005246 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-1d17d4ec-c878-408c-9e03-5061eec4c80d tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:41:04.006051 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-1d17d4ec-c878-408c-9e03-5061eec4c80d tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] [instance: 529a34b2-5f55-4469-bace-404db6318de3] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:41:04.012317 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-1d17d4ec-c878-408c-9e03-5061eec4c80d tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:41:04.012771 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-1d17d4ec-c878-408c-9e03-5061eec4c80d tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:41:04.013558 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-1d17d4ec-c878-408c-9e03-5061eec4c80d tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:41:04.014587 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-1d17d4ec-c878-408c-9e03-5061eec4c80d tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:41:04.143367 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-1d17d4ec-c878-408c-9e03-5061eec4c80d tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef8571ef39b4efe8f510a28052e2b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84bceeeb4f67456a90779360ffc620aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:41:04.151169 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-1d17d4ec-c878-408c-9e03-5061eec4c80d tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] 10.222.0.87 "GET /compute/v2.1/servers/529a34b2-5f55-4469-bace-404db6318de3" status: 200 len: 1460 microversion: 2.1 time: 0.149999 Oct 29 01:41:04.151742 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 636/1284] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:41:03 2021] GET /compute/v2.1/servers/529a34b2-5f55-4469-bace-404db6318de3 => generated 1460 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 01:41:04.830967 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [req-28592098-e637-4ab4-9065-91a47bafc6a5 req-1fe45d92-5a66-4a9f-8685-bc6609f80b07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "529a34b2-5f55-4469-bace-404db6318de3", "name": "network-vif-deleted", "tag": "704607c3-0bdb-4458-b12a-5f98dc711d46"}]} {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 01:41:04.832942 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 01:41:04.832942 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: warnings.warn(msg) Oct 29 01:41:04.840375 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [req-28592098-e637-4ab4-9065-91a47bafc6a5 req-1fe45d92-5a66-4a9f-8685-bc6609f80b07 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:41:04.840814 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [req-28592098-e637-4ab4-9065-91a47bafc6a5 req-1fe45d92-5a66-4a9f-8685-bc6609f80b07 service nova] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:41:04.851759 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.compute.server_external_events [req-28592098-e637-4ab4-9065-91a47bafc6a5 req-1fe45d92-5a66-4a9f-8685-bc6609f80b07 service nova] Creating event network-vif-deleted:704607c3-0bdb-4458-b12a-5f98dc711d46 for instance 529a34b2-5f55-4469-bace-404db6318de3 on hv-cinder-81398 Oct 29 01:41:04.856581 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [req-28592098-e637-4ab4-9065-91a47bafc6a5 req-1fe45d92-5a66-4a9f-8685-bc6609f80b07 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029972 Oct 29 01:41:04.857158 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 649/1285] 10.222.0.87 () {64 vars in 1317 bytes} [Fri Oct 29 01:41:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 01:41:05.167392 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-ee9854f2-3362-4d57-a28f-3dd65dbba6db tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:41:05.168081 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-ee9854f2-3362-4d57-a28f-3dd65dbba6db tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] [instance: 529a34b2-5f55-4469-bace-404db6318de3] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:41:05.175182 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-ee9854f2-3362-4d57-a28f-3dd65dbba6db tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:41:05.175662 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-ee9854f2-3362-4d57-a28f-3dd65dbba6db tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:41:05.176696 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-ee9854f2-3362-4d57-a28f-3dd65dbba6db tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:41:05.177129 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-ee9854f2-3362-4d57-a28f-3dd65dbba6db tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:41:05.241954 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.policy [None req-ee9854f2-3362-4d57-a28f-3dd65dbba6db tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef8571ef39b4efe8f510a28052e2b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84bceeeb4f67456a90779360ffc620aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116379) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 01:41:05.251948 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-ee9854f2-3362-4d57-a28f-3dd65dbba6db tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] 10.222.0.87 "GET /compute/v2.1/servers/529a34b2-5f55-4469-bace-404db6318de3" status: 200 len: 1226 microversion: 2.1 time: 0.088166 Oct 29 01:41:05.261803 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 637/1286] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:41:05 2021] GET /compute/v2.1/servers/529a34b2-5f55-4469-bace-404db6318de3 => generated 1226 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 01:41:06.269569 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-f773f8b6-00df-4f38-ba88-8dbed2ebf321 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:41:06.270159 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-f773f8b6-00df-4f38-ba88-8dbed2ebf321 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] [instance: 529a34b2-5f55-4469-bace-404db6318de3] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:41:06.276402 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-f773f8b6-00df-4f38-ba88-8dbed2ebf321 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:41:06.276854 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-f773f8b6-00df-4f38-ba88-8dbed2ebf321 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:41:06.277632 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-f773f8b6-00df-4f38-ba88-8dbed2ebf321 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:41:06.278069 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-f773f8b6-00df-4f38-ba88-8dbed2ebf321 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:41:06.292013 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.wsgi [None req-f773f8b6-00df-4f38-ba88-8dbed2ebf321 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] HTTP exception thrown: Instance 529a34b2-5f55-4469-bace-404db6318de3 could not be found. Oct 29 01:41:06.292611 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-f773f8b6-00df-4f38-ba88-8dbed2ebf321 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Returning 404 to user: Instance 529a34b2-5f55-4469-bace-404db6318de3 could not be found. {{(pid=116378) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:41:06.293451 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-f773f8b6-00df-4f38-ba88-8dbed2ebf321 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] 10.222.0.87 "GET /compute/v2.1/servers/529a34b2-5f55-4469-bace-404db6318de3" status: 404 len: 111 microversion: 2.1 time: 0.028740 Oct 29 01:41:06.293989 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 650/1287] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:41:06 2021] GET /compute/v2.1/servers/529a34b2-5f55-4469-bace-404db6318de3 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:41:06.869641 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-2b372419-2986-41c2-a53c-4080d18a4d0b tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Calling method '>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:41:06.870278 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.compute.api [None req-2b372419-2986-41c2-a53c-4080d18a4d0b tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] [instance: f69664c9-6a0c-4807-a429-f39a1823f6ac] Fetching instance by UUID {{(pid=116379) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:41:06.877292 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-2b372419-2986-41c2-a53c-4080d18a4d0b tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:41:06.877741 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-2b372419-2986-41c2-a53c-4080d18a4d0b tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:41:06.878802 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-2b372419-2986-41c2-a53c-4080d18a4d0b tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:41:06.879377 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG oslo_concurrency.lockutils [None req-2b372419-2986-41c2-a53c-4080d18a4d0b tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116379) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:41:06.892796 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.wsgi [None req-2b372419-2986-41c2-a53c-4080d18a4d0b tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] HTTP exception thrown: Instance f69664c9-6a0c-4807-a429-f39a1823f6ac could not be found. Oct 29 01:41:06.893384 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-2b372419-2986-41c2-a53c-4080d18a4d0b tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Returning 404 to user: Instance f69664c9-6a0c-4807-a429-f39a1823f6ac could not be found. {{(pid=116379) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:41:06.894205 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-2b372419-2986-41c2-a53c-4080d18a4d0b tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] 10.222.0.87 "DELETE /compute/v2.1/servers/f69664c9-6a0c-4807-a429-f39a1823f6ac" status: 404 len: 111 microversion: 2.1 time: 0.028384 Oct 29 01:41:06.894763 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 638/1288] 10.222.0.87 () {58 vars in 1238 bytes} [Fri Oct 29 01:41:06 2021] DELETE /compute/v2.1/servers/f69664c9-6a0c-4807-a429-f39a1823f6ac => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:41:06.902651 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-96d9ff34-08fb-4baa-9946-416b04b96f26 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Calling method '>' {{(pid=116378) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:41:06.903254 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.compute.api [None req-96d9ff34-08fb-4baa-9946-416b04b96f26 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] [instance: f69664c9-6a0c-4807-a429-f39a1823f6ac] Fetching instance by UUID {{(pid=116378) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 01:41:06.909714 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-96d9ff34-08fb-4baa-9946-416b04b96f26 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:41:06.910160 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-96d9ff34-08fb-4baa-9946-416b04b96f26 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:41:06.910928 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-96d9ff34-08fb-4baa-9946-416b04b96f26 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 01:41:06.911358 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG oslo_concurrency.lockutils [None req-96d9ff34-08fb-4baa-9946-416b04b96f26 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Lock "20da1628-5ce3-4c52-99e0-a722d80928b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116378) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 01:41:06.925218 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.wsgi [None req-96d9ff34-08fb-4baa-9946-416b04b96f26 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] HTTP exception thrown: Instance f69664c9-6a0c-4807-a429-f39a1823f6ac could not be found. Oct 29 01:41:06.925806 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: DEBUG nova.api.openstack.wsgi [None req-96d9ff34-08fb-4baa-9946-416b04b96f26 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Returning 404 to user: Instance f69664c9-6a0c-4807-a429-f39a1823f6ac could not be found. {{(pid=116378) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 01:41:06.926631 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO nova.api.openstack.requestlog [None req-96d9ff34-08fb-4baa-9946-416b04b96f26 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] 10.222.0.87 "GET /compute/v2.1/servers/f69664c9-6a0c-4807-a429-f39a1823f6ac" status: 404 len: 111 microversion: 2.1 time: 0.027670 Oct 29 01:41:06.927186 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: [pid: 116378|app: 0|req: 651/1289] 10.222.0.87 () {58 vars in 1235 bytes} [Fri Oct 29 01:41:06 2021] GET /compute/v2.1/servers/f69664c9-6a0c-4807-a429-f39a1823f6ac => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 01:41:08.492451 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: DEBUG nova.api.openstack.wsgi [None req-a597fba2-d20b-442a-8d81-0c430f2f8bc3 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] Calling method '.version_select at 0x7ff62c2453a0>' {{(pid=116379) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 01:41:08.565951 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO nova.api.openstack.requestlog [None req-a597fba2-d20b-442a-8d81-0c430f2f8bc3 tempest-TestVolumeBootPattern-86232389 tempest-TestVolumeBootPattern-86232389-project] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1481000100" status: 202 len: 0 microversion: 2.1 time: 0.077160 Oct 29 01:41:08.566714 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: [pid: 116379|app: 0|req: 639/1290] 10.222.0.87 () {58 vars in 1262 bytes} [Fri Oct 29 01:41:08 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1481000100 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 01:42:25.646493 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 01:42:25.647137 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: Fri Oct 29 01:42:25 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 29 01:44:13.914791 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 01:44:13.915341 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: Fri Oct 29 01:44:13 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 29 01:44:14.459575 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 01:44:14.460206 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: Fri Oct 29 01:44:14 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 29 01:44:16.919023 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 01:44:16.919555 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: Fri Oct 29 01:44:16 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 29 01:44:20.350767 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 01:44:20.351390 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: Fri Oct 29 01:44:20 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 29 01:45:45.664722 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 01:45:45.665525 dv-cinder-813984-5-iscsi devstack@n-api.service[116378]: Fri Oct 29 01:45:45 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 29 01:46:12.998446 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 01:46:12.999098 dv-cinder-813984-5-iscsi devstack@n-api.service[116379]: Fri Oct 29 01:46:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!